-- Logs begin at Thu 2022-09-01 07:35:07 UTC, end at Thu 2022-09-01 09:10:28 UTC. -- Sep 01 08:00:25.995752 dv-cinder-855479-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 08:00:26.003529 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 08:00:26.005581 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 08:00:26 2022] *** Sep 01 08:00:26.005581 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 08:00:26.005581 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 08:00:26.005581 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: nodename: dv-cinder-855479-1-iscsi Sep 01 08:00:26.005581 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: machine: x86_64 Sep 01 08:00:26.005581 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: clock source: unix Sep 01 08:00:26.005581 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: pcre jit disabled Sep 01 08:00:26.005581 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: detected number of CPU cores: 4 Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: current working directory: / Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: detected binary path: /usr/bin/uwsgi-core Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: your processes number limit is 47680 Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: your memory page size is 4096 bytes Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: detected max file descriptor number: 2048 Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: lock engine: pthread robust mutexes Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: thunder lock: enabled Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 08:00:26.006105 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 08:00:26.047666 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: Python main interpreter initialized at 0x5605a3a8e9c0 Sep 01 08:00:26.047666 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: python threads support enabled Sep 01 08:00:26.047666 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: your server socket listen backlog is limited to 100 connections Sep 01 08:00:26.047666 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: your mercy for graceful operations on workers is 90 seconds Sep 01 08:00:26.048090 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 08:00:26.048167 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: *** Operational MODE: preforking *** Sep 01 08:00:26.048449 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: *** uWSGI is running in multiple interpreter mode *** Sep 01 08:00:26.048449 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: spawned uWSGI master process (pid: 81687) Sep 01 08:00:26.049981 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: spawned uWSGI worker 1 (pid: 81701, cores: 1) Sep 01 08:00:26.049981 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: spawned uWSGI worker 2 (pid: 81702, cores: 1) Sep 01 08:00:26.049981 dv-cinder-855479-1-iscsi devstack@keystone.service[81687]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 08:00:26.048684 dv-cinder-855479-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 01 08:00:30.360576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:00:30.360576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: from cryptography.utils import int_from_bytes Sep 01 08:00:30.361774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:00:30.361774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: from cryptography.utils import int_from_bytes Sep 01 08:00:30.362379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:00:30.362379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: from cryptography.utils import int_from_bytes Sep 01 08:00:30.362500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:00:30.362500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: from cryptography.utils import int_from_bytes Sep 01 08:00:30.411712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 08:00:30.411935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 08:00:30.412075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] command line args: [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 08:00:30.412353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 08:00:30.412528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ================================================================================ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 08:00:30.412649 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 08:00:30.412777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] admin_token = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.412861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 08:00:30.412999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] command line args: [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 08:00:30.413087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] config_dir = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.413198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.413286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 08:00:30.413364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] config_source = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.413441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ================================================================================ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 08:00:30.413546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] debug = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.413685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] admin_token = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.413824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.414148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] config_dir = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.414287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.414406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.414509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.414631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] config_source = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.414631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] debug = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.415566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.415689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.415815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.415914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] log_config_append = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] log_dir = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] log_file = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.416989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] log_config_append = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] log_dir = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] log_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.417989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.418981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.419988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] publish_errors = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.420993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.421304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.421304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] publish_errors = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.421523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.421611 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.421731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.421813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.421902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] standard_threads = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.421984 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422138 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] use_journal = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] standard_threads = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] use_json = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] use_stderr = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.422865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] use_syslog = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.423048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.423048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.423186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.423258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] use_journal = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.423340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.423412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] use_json = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.423412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] use_stderr = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.423630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.423767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] use_syslog = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.423895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:30.424142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424506 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.424873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425506 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.425961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.426043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.426121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.426311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.426440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.426521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.426594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.426773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.426854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.427997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.428991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.429134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.429212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.429389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.429498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.429631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.429738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.429858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.429935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.430091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.430799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.431432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.431669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.431796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.431897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.431981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.432929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.433948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.434947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.435933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.436980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.437991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.438091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.438204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.438408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.438530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.438530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.438832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.438994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.439947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.440051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.440153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.440249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.440344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.440438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.440607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.440759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.440917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.441983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.442951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.443053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.443175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.443367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.443542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.443762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.443951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.444132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.444319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.444510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.444707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.444891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.445074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.445259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.445405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.445641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.445770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.447294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.447499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.447636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.447790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.447939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.448085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.448212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.448334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.448450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.448568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.448704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.448850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.448986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.449119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.449247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.449368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.449486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.449626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.449760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.449911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.450057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.450183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.450325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.450471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.450603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.450738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.450872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.450995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.external = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.451132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.451315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.451445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.451571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.451700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.451831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.451972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.external = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.452106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.password = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.452233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.452369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] auth.token = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.452369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.452603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.452733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.452867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.453000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.453143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.password = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.453270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.453392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.token = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.453511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.453629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.453759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.453906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.454039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.454170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.454346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.454491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.454622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.454768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.454903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.455033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.455162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.455282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.455410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.455560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.455694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.455825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.455951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.456074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.456192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.456324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.456454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.456587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.456721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.456852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.456977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.457116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.457238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.457356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.457482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.457613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.457746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.457895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.458015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.458143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.458297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.458416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.458528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.458658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.458776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.458906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.459036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.459171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.459323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.459452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.459574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.459695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.459826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.459948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.460081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.460220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.460351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.460485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.460616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.460740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.460875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.460999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.461121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.461251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.461384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.462014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.462745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.462886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.463024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.463156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.463282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.463404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.463640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.463775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.463900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.464825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.465980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.466092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.466209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.466354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.466494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.466494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.466686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.466793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.466897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.467935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.468940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.469053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.469152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.469250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.469351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.469526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.469709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.469884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.470047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.470203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.470449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.470609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.470787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.470947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.471102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.471977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.472980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.473099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.473211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.473333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.473432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.473552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.473674 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.473785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.473907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.474039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.474152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.474297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.474474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.474605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.474738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.474902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.475033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.475157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.475277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.475407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.475540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.475680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.475800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.475927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.476053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.476178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.476302 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.476443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.476573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.476700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.476828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.476957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.477144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.477946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.478092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.478226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.478399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.478528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.478657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.478804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.478936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.479066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.479193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.479320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.479447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.479588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.479718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.479855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.479985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.480122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.480248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.480389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.480519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.480645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.480770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.480896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.481034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.481174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.481301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.481427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.481555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.481683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.481803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.481942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.482081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.482210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.482361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.482489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.482618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.482764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.482892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.483994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.484120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.484260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.484378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.484497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.484497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.484715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.484715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.484940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.485066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.485185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.485309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.485428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.485550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.485693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.485826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.485952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.486074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.486196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.486346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.486483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.486613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.486744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.486877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.487011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.487139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.487275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.487393 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.487517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.487650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.487784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.487927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.488062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.488186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.488312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.488432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.488547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.488660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.488887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.489022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.489156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] role.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.489292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.489429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] role.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.489813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.489950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.490071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.490189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.490397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.490534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.490686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] role.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.490816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.490942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] role.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.491066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.491195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.491314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.491457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.491592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.491726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.491854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.491981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.492104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.492234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.492357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.492490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.492625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.493666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.493800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.493943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.494072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.494198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.494350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.494484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.494484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.494715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.494840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.494943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.495068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.495200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.495335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.495486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.495486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.495701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.495832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.495955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.496071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.496195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.496308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.496423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.496534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.496655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.496797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.496935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.497067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.497198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.497324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.497448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.497582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.497698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.497819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.497952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.498086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.498209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.498455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.498577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.498692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.498818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.498950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.498950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.499199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.499324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] token.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.499446 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.499561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.499679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.499807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.499952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] token.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.500927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.501146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.501146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.501359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.501359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.501566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.501682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.501796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.501906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.502028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.502142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.502276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.502378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.502474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.502592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.502738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.502870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.503018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.503165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.503292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.503292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.503511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.503653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.503789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.503789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.504029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.504029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.504269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.504269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.504517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.504661 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.504796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.504933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.505054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.505179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.505304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.505437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.505560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.505672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.505795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.505922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.506053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.506198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.506378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.506563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.506696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.506824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.506936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.507084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.507219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.507342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.507465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.507591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.507711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.507842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.507959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.508137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.508296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.508464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.509359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.509508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 08:00:30.509637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.509637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.509637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.509637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.509637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:30.509637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 08:00:30.529635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.529854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.530077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.532689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.532928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.533153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.538461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.542489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.567405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.567621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.568786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.569020 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.623371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.623655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.672981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.673208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.673629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.673867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.831345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.831585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.831794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.832010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.832226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.832441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.832638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.832874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.833099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.833320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.833540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.833756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.856441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.856625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.856701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.856779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.856892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.857856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.870298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.870497 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.883935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.884157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.884157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.884392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.884529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.884529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.884792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.884916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.885045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.885171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.885300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.885449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81701) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.885585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.885585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:30.902758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.902992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 08:00:30.903269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.903482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 08:00:30.903569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.903772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 08:00:30.903905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.904055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 08:00:30.904189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.904320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.904447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.904577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.904712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.904815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.904893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.905028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.914167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.914483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.915246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.915527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.915982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.916303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.916489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.916489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.922806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.923146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.925712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.926003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.926101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.926314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.926412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.926600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.926691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.926885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.926994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.927151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.927246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.927416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.927539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.927687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.927850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.927945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.928106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.928200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.928381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.928471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.928654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.928734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.952440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.952756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.953947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.954234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.954405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.954561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.958796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.959081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.959281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.959426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.959569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.959860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.974266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.974266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.974551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.974551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.974686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.974686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.974686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.974857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.974922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.974983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975435 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975435 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.975435 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.990863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.991159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.991390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.991693 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.995114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.995742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:30.998309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.998617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.998935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:30.999242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.003000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.003456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.006112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.006747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.009747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.010047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.010356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.010509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.010684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.010862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.011012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.011146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.011288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.011439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.011723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.012007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.027152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.027450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.027721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.027996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.028145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.028451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.028723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.028994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.034763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.035904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.036440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.037438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.038007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.038298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.039036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.039311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.041458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.041750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.042049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.042361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.042648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.042775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.042945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.043241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.043532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.043824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.053868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.054164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.054474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.054758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.055043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.055260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.055962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.056112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.056275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.056407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.056605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.057173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.057462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.071887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.072892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.074938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.075845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.077774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.078764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.079239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.080337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.080717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.081003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.081289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.081821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.082123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.082437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.087933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.088911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.089423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.090535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.092294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.092592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.092885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.093180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.093406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.093703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.093998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.094294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.101093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.101390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.101672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.102896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.103121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.103405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.109224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81701) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.109510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.109793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.110078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.110227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:31.110377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.110482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.110655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.110796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.110943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.111114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.111207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.111298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.111480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.111619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.111755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.111838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.112024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.112105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.112292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.112491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.112617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.112774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.112858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81701) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.113057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.113331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.113603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.113887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:31.148231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605a3a8e9c0 pid: 81701 (default app) Sep 01 08:00:31.150478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605a3a8e9c0 pid: 81702 (default app) Sep 01 08:00:31.152524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9933259-6c0c-4797-b2fd-4e45a49a7dfc None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:31.152849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9933259-6c0c-4797-b2fd-4e45a49a7dfc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:31.153167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9933259-6c0c-4797-b2fd-4e45a49a7dfc None None] PATH_INFO: `/v3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:31.157325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Thu Sep 1 08:00:31 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:38.053899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a2e9-9858-4f57-93b7-39a34d8f766d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:38.054535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a2e9-9858-4f57-93b7-39a34d8f766d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:38.054535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a2e9-9858-4f57-93b7-39a34d8f766d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:38.059463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:38.065195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:38.065783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:38.065783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:38.137038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: INFO dbcounter [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] Registered counter for database keystone Sep 01 08:00:38.157180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG oslo_db.sqlalchemy.engines [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:00:38.163541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writer thread running {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:00:38.363675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG passlib.handlers.bcrypt [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81701) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 08:00:38.364250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG passlib.handlers.bcrypt [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81701) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 08:00:38.431548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:38.433167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:38.568879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 01 08:00:38.869728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a2e9-9858-4f57-93b7-39a34d8f766d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:38.938882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: INFO dbcounter [None req-7215a2e9-9858-4f57-93b7-39a34d8f766d None None] Registered counter for database keystone Sep 01 08:00:38.961317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG oslo_db.sqlalchemy.engines [None req-7215a2e9-9858-4f57-93b7-39a34d8f766d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:00:38.968799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writer thread running {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:00:39.093283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a2e9-9858-4f57-93b7-39a34d8f766d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:39.097802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7e39-9040-4842-bd3b-62a892c805e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:39.098502 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7e39-9040-4842-bd3b-62a892c805e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:39.098792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7e39-9040-4842-bd3b-62a892c805e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:39.099070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7e39-9040-4842-bd3b-62a892c805e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:39.108566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc7e39-9040-4842-bd3b-62a892c805e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:39.160382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-35cc7e39-9040-4842-bd3b-62a892c805e4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 08:00:39.160631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc7e39-9040-4842-bd3b-62a892c805e4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:39.172200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Sep 1 08:00:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:00:39.178455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:39.193878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafd148-7c26-4013-bc3f-49e4734d2476 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:39.199255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683f95-ba36-40aa-95ec-83858aedfaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:39.200672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683f95-ba36-40aa-95ec-83858aedfaea admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:39.200959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683f95-ba36-40aa-95ec-83858aedfaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:39.201235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683f95-ba36-40aa-95ec-83858aedfaea admin admin] PATH_INFO: `/v3/projects/41333422ff5e4255bb6c2174f444b692` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:39.202906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98683f95-ba36-40aa-95ec-83858aedfaea admin admin] RBAC: Authorizing `identity:get_project(project_id=41333422ff5e4255bb6c2174f444b692)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:39.260984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98683f95-ba36-40aa-95ec-83858aedfaea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 08:00:39.261335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98683f95-ba36-40aa-95ec-83858aedfaea admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:39.266149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Thu Sep 1 08:00:39 2022] GET /identity/v3/projects/41333422ff5e4255bb6c2174f444b692 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:41.176454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92b66-5eaf-4baa-b85e-ae0b43d0922f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:41.177001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92b66-5eaf-4baa-b85e-ae0b43d0922f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:41.177001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92b66-5eaf-4baa-b85e-ae0b43d0922f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:41.181745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:41.187233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e6b3-ab52-43f7-8f58-1d2dfb4e3295 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:41.187656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e6b3-ab52-43f7-8f58-1d2dfb4e3295 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:41.187784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e6b3-ab52-43f7-8f58-1d2dfb4e3295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:41.208223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9dd2e6b3-ab52-43f7-8f58-1d2dfb4e3295 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:41.209722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9dd2e6b3-ab52-43f7-8f58-1d2dfb4e3295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:41.217530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 08:00:41.488062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d92b66-5eaf-4baa-b85e-ae0b43d0922f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:41.501162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d92b66-5eaf-4baa-b85e-ae0b43d0922f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:41.505299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac8201-b881-45ed-b80d-bdd6bf58008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:41.505894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8201-b881-45ed-b80d-bdd6bf58008c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:41.506171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8201-b881-45ed-b80d-bdd6bf58008c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:41.506471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8201-b881-45ed-b80d-bdd6bf58008c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:41.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac8201-b881-45ed-b80d-bdd6bf58008c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:41.516537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac8201-b881-45ed-b80d-bdd6bf58008c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:41.525910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Sep 1 08:00:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:00:41.531839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2e6b3-ab52-43f7-8f58-1d2dfb4e3295 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:41.541674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2e6b3-ab52-43f7-8f58-1d2dfb4e3295 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:41.546037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b995c-bf3c-4989-a00f-e1f725a4c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:41.546706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b995c-bf3c-4989-a00f-e1f725a4c2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:41.546992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b995c-bf3c-4989-a00f-e1f725a4c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:41.547270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b995c-bf3c-4989-a00f-e1f725a4c2a3 admin admin] PATH_INFO: `/v3/users/d2d8becce6b1469fa561088c062a1608` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:41.548593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b995c-bf3c-4989-a00f-e1f725a4c2a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=d2d8becce6b1469fa561088c062a1608)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:41.550555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b995c-bf3c-4989-a00f-e1f725a4c2a3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:41.552121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Thu Sep 1 08:00:41 2022] GET /identity/v3/users/d2d8becce6b1469fa561088c062a1608 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:43.563517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43219b-5b09-49ee-b292-81d1b85ab3e6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:43.564256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43219b-5b09-49ee-b292-81d1b85ab3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:43.564256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43219b-5b09-49ee-b292-81d1b85ab3e6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:43.566300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:43.574736 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eb1dc-cdbb-418a-840e-e2335e4542d2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:43.575498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eb1dc-cdbb-418a-840e-e2335e4542d2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:43.575707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eb1dc-cdbb-418a-840e-e2335e4542d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:43.590848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b496a8-1c26-4467-9f25-3d87a2b664b2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:43.591332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b496a8-1c26-4467-9f25-3d87a2b664b2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:43.591813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b496a8-1c26-4467-9f25-3d87a2b664b2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:43.594211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:43.600522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-aa9eb1dc-cdbb-418a-840e-e2335e4542d2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:43.602249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aa9eb1dc-cdbb-418a-840e-e2335e4542d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:43.604686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:43.605189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:43.605684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:43.682047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG passlib.handlers.bcrypt [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 08:00:43.682636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG passlib.handlers.bcrypt [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 08:00:43.709285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:43.734332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:43.736041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:43.846451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:43.983800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eb1dc-cdbb-418a-840e-e2335e4542d2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:44.025697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:44.122019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:44.165026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eb1dc-cdbb-418a-840e-e2335e4542d2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:44.211984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d62ef-fe19-4aaa-af47-9a5458f000e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:44.213442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d62ef-fe19-4aaa-af47-9a5458f000e5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:44.213900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d62ef-fe19-4aaa-af47-9a5458f000e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:44.214384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d62ef-fe19-4aaa-af47-9a5458f000e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:44.231651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d62ef-fe19-4aaa-af47-9a5458f000e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-641d62ef-fe19-4aaa-af47-9a5458f000e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:44.240871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:44.242247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:00:44.243597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:44.248876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d62ef-fe19-4aaa-af47-9a5458f000e5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:44.258541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80757c28-a2d0-4d40-94d7-9061ceac1445 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:44.262300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:44.311564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ee3c-b67d-4bb1-966c-0fdaa64d284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:44.312591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ee3c-b67d-4bb1-966c-0fdaa64d284b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:44.313004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ee3c-b67d-4bb1-966c-0fdaa64d284b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:44.313326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ee3c-b67d-4bb1-966c-0fdaa64d284b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:44.357926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:44.381059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d62ef-fe19-4aaa-af47-9a5458f000e5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:44.396724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ee3c-b67d-4bb1-966c-0fdaa64d284b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:44.398530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ee3c-b67d-4bb1-966c-0fdaa64d284b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:44.424448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:44.425216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:44.425592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:44.425950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:44.426756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:44.427165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:44.428758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:44.443367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:44.449912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:44.532991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:00:44.541813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ee3c-b67d-4bb1-966c-0fdaa64d284b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:44.546149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:44.584402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff49cf9-50f5-4840-9c7a-0b95cbf6065a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:44.627426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2ffe1-643e-4deb-b951-d71f3914b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:44.628233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2ffe1-643e-4deb-b951-d71f3914b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:44.628582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2ffe1-643e-4deb-b951-d71f3914b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:44.628995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2ffe1-643e-4deb-b951-d71f3914b2d8 None admin] PATH_INFO: `/v3/users/d2d8becce6b1469fa561088c062a1608` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:44.630576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2ffe1-643e-4deb-b951-d71f3914b2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d2d8becce6b1469fa561088c062a1608)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:44.632118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2ffe1-643e-4deb-b951-d71f3914b2d8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:44.634632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:44 2022] GET /identity/v3/users/d2d8becce6b1469fa561088c062a1608 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:44.640668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2ffe1-643e-4deb-b951-d71f3914b2d8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:44.657751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:44.670294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ee3c-b67d-4bb1-966c-0fdaa64d284b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:44.723304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:44.724386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:44.724791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:44.725181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:44.748381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:44.749871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:44.754897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2ffe1-643e-4deb-b951-d71f3914b2d8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:00:44.770452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:44.772134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:00:44.773681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:00:44.773681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:00:44.773681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:00:44.773681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:00:44.780512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:44.805365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa21bd-1102-43ba-a6ac-40b295c41002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:44.806986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa21bd-1102-43ba-a6ac-40b295c41002 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:44.807557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa21bd-1102-43ba-a6ac-40b295c41002 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:44.807912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa21bd-1102-43ba-a6ac-40b295c41002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:44.809403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa21bd-1102-43ba-a6ac-40b295c41002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:44.811114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa21bd-1102-43ba-a6ac-40b295c41002 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:44.813050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:44.823044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa21bd-1102-43ba-a6ac-40b295c41002 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:44.853481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:44.914956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad56fdd-d25e-4dcf-b7c6-80a7b665d391 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:44.934312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:44.960351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa21bd-1102-43ba-a6ac-40b295c41002 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:44.965377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa11e73-6873-4dc9-a73a-3ef87b55d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:44.966072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa11e73-6873-4dc9-a73a-3ef87b55d025 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:44.966468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa11e73-6873-4dc9-a73a-3ef87b55d025 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:44.966811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa11e73-6873-4dc9-a73a-3ef87b55d025 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:44.967587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa11e73-6873-4dc9-a73a-3ef87b55d025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:44.967952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa11e73-6873-4dc9-a73a-3ef87b55d025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:44.969447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa11e73-6873-4dc9-a73a-3ef87b55d025 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:44.989713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 10/20] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:45.001240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d499c7b-87f2-42e5-a5e9-b10669a9eb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:45.001879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d499c7b-87f2-42e5-a5e9-b10669a9eb5b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:45.002163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d499c7b-87f2-42e5-a5e9-b10669a9eb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:45.002628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d499c7b-87f2-42e5-a5e9-b10669a9eb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:45.003463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d499c7b-87f2-42e5-a5e9-b10669a9eb5b None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.domain.id=default, user.id=d2d8becce6b1469fa561088c062a1608) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:45.003833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d499c7b-87f2-42e5-a5e9-b10669a9eb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:45.005449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d499c7b-87f2-42e5-a5e9-b10669a9eb5b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:45.014712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 11/21] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Sep 1 08:00:44 2022] GET /identity/v3/role_assignments?user.id=d2d8becce6b1469fa561088c062a1608&scope.domain.id=default&role.id=b76f0bbd02794923b10af161becac1c6 => generated 233 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:47.191035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6688-d0c5-42ca-b134-3ec87222e6fc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.191801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6688-d0c5-42ca-b134-3ec87222e6fc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.191801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6688-d0c5-42ca-b134-3ec87222e6fc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.193290 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 11/22] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:47.199460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fd75d-dfb6-4537-aecc-539a70f1ace9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.200193 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fd75d-dfb6-4537-aecc-539a70f1ace9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.200193 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fd75d-dfb6-4537-aecc-539a70f1ace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.237239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fb5fd75d-dfb6-4537-aecc-539a70f1ace9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:47.239239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fb5fd75d-dfb6-4537-aecc-539a70f1ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:47.421955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:47.980174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d6688-d0c5-42ca-b134-3ec87222e6fc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.130227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d6688-d0c5-42ca-b134-3ec87222e6fc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.151171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:48.172702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f255ae-9af8-411a-8ada-0b797a56f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.173375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f255ae-9af8-411a-8ada-0b797a56f119 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.173657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f255ae-9af8-411a-8ada-0b797a56f119 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.174078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f255ae-9af8-411a-8ada-0b797a56f119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.187718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f255ae-9af8-411a-8ada-0b797a56f119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.189234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f255ae-9af8-411a-8ada-0b797a56f119 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b4f255ae-9af8-411a-8ada-0b797a56f119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:00:48.211927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:48.214821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:00:48.216381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:00:48.216381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:00:48.216381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:00:48.216381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 12/24] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:48.223524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fd75d-dfb6-4537-aecc-539a70f1ace9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.355095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:48.363128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cd374-ecc3-40a7-912f-8de4637f90fa None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.363632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cd374-ecc3-40a7-912f-8de4637f90fa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.364142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cd374-ecc3-40a7-912f-8de4637f90fa None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.374523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 13/25] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:48.379422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f644bd-1c8f-45a2-8653-51bafc85020e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.380142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f644bd-1c8f-45a2-8653-51bafc85020e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.380777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f644bd-1c8f-45a2-8653-51bafc85020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.391555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fd75d-dfb6-4537-aecc-539a70f1ace9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.415836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-34f644bd-1c8f-45a2-8653-51bafc85020e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:48.418442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-34f644bd-1c8f-45a2-8653-51bafc85020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:48.437631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.438302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.438609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.438890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.439571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:48.439882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.441441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:48.461494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 13/26] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:48.474531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.650673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 14/27] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:48.757652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae151d38-800b-4448-a349-a4e7f79943b9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.843033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe23e1-b5ea-4bb8-a8d4-6f924f0daed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.844590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe23e1-b5ea-4bb8-a8d4-6f924f0daed0 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.845309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe23e1-b5ea-4bb8-a8d4-6f924f0daed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.846081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe23e1-b5ea-4bb8-a8d4-6f924f0daed0 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.847715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe23e1-b5ea-4bb8-a8d4-6f924f0daed0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.850812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe23e1-b5ea-4bb8-a8d4-6f924f0daed0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:48.867522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:49.040949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07418319-8986-439c-a398-673be01a6b7f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.041499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07418319-8986-439c-a398-673be01a6b7f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.042335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07418319-8986-439c-a398-673be01a6b7f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.045137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 15/28] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:49.053526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67b9c6-f879-4a6b-b614-7dbcfadc2aea None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.054491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67b9c6-f879-4a6b-b614-7dbcfadc2aea None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.055268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67b9c6-f879-4a6b-b614-7dbcfadc2aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.070682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 14/29] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:00:48 2022] POST /identity/v3/projects => generated 301 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:00:49.095521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3b67b9c6-f879-4a6b-b614-7dbcfadc2aea None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:49.097056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3b67b9c6-f879-4a6b-b614-7dbcfadc2aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:49.205211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:49.296395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe23e1-b5ea-4bb8-a8d4-6f924f0daed0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:49.404840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8e44-9487-4aad-bbce-e0987a13202d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.405352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8e44-9487-4aad-bbce-e0987a13202d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.405808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e8e44-9487-4aad-bbce-e0987a13202d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.408792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 17/31] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:49.418062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef16d2-644e-4818-b3c4-fdfbde1e523a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.418620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef16d2-644e-4818-b3c4-fdfbde1e523a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.419105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef16d2-644e-4818-b3c4-fdfbde1e523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.484162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e6ef16d2-644e-4818-b3c4-fdfbde1e523a None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:49.486218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e6ef16d2-644e-4818-b3c4-fdfbde1e523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:49.499582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe23e1-b5ea-4bb8-a8d4-6f924f0daed0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:49.541641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:49.585992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfafbcf-0549-47ca-afc4-85beebc6ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:49.587087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafbcf-0549-47ca-afc4-85beebc6ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.588236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafbcf-0549-47ca-afc4-85beebc6ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.588751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafbcf-0549-47ca-afc4-85beebc6ccb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.637766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfafbcf-0549-47ca-afc4-85beebc6ccb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-edfafbcf-0549-47ca-afc4-85beebc6ccb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:49.653749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:49.654713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:49.655456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:00:49.656031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 15/32] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:49.667842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfafbcf-0549-47ca-afc4-85beebc6ccb9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:49.702543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 18/33] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:49.733231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef16d2-644e-4818-b3c4-fdfbde1e523a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:49.783489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:49.854150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef16d2-644e-4818-b3c4-fdfbde1e523a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:49.901795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceaef4-cd9f-483d-91ea-4c8a5549e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:49.902593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceaef4-cd9f-483d-91ea-4c8a5549e934 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.902866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceaef4-cd9f-483d-91ea-4c8a5549e934 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.903142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceaef4-cd9f-483d-91ea-4c8a5549e934 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.903917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ceaef4-cd9f-483d-91ea-4c8a5549e934 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:49.905795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ceaef4-cd9f-483d-91ea-4c8a5549e934 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:49.978055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfafbcf-0549-47ca-afc4-85beebc6ccb9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:50.093016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 19/34] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 08:00:49 2022] POST /identity/v3/roles => generated 225 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:50.125325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:50.126861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.127622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.128363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.129937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:50.130829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:50.134096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:50.155011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5f3bc-cca8-4027-bdac-dc4a1579f228 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.155011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5f3bc-cca8-4027-bdac-dc4a1579f228 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.155011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5f3bc-cca8-4027-bdac-dc4a1579f228 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.155011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 20/35] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:50.162974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b118d8-ff2b-4d29-8328-44fb019198de None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.163522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b118d8-ff2b-4d29-8328-44fb019198de None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.164194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b118d8-ff2b-4d29-8328-44fb019198de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.167274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 16/36] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:50.177050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:50.217366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-03b118d8-ff2b-4d29-8328-44fb019198de None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:50.220157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-03b118d8-ff2b-4d29-8328-44fb019198de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:50.273170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:50.354937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 21/37] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:50.354937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b118d8-ff2b-4d29-8328-44fb019198de None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:50.404534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da56e9-94b0-440f-a0a9-e25df2e4fb1b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:50.417626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:50.453419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e560cf1-a266-4b40-99c4-2d7a2754a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:50.454423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560cf1-a266-4b40-99c4-2d7a2754a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.454867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560cf1-a266-4b40-99c4-2d7a2754a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.455305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560cf1-a266-4b40-99c4-2d7a2754a2b7 None admin] PATH_INFO: `/v3/users/d2d8becce6b1469fa561088c062a1608` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.457109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e560cf1-a266-4b40-99c4-2d7a2754a2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=d2d8becce6b1469fa561088c062a1608)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:50.458672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e560cf1-a266-4b40-99c4-2d7a2754a2b7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:50.460456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 17/38] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:50 2022] GET /identity/v3/users/d2d8becce6b1469fa561088c062a1608 => generated 247 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:50.462875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303f8b7-bef7-4d9f-a456-0b1359ce621d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.463370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303f8b7-bef7-4d9f-a456-0b1359ce621d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.463853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303f8b7-bef7-4d9f-a456-0b1359ce621d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.466573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 18/39] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:50.473311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303f8b7-bef7-4d9f-a456-0b1359ce621d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:50.505618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b118d8-ff2b-4d29-8328-44fb019198de None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:50.552117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb4798-46b8-428f-acf2-349b84eb8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:50.553037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb4798-46b8-428f-acf2-349b84eb8a9d None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.553400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb4798-46b8-428f-acf2-349b84eb8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.553803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb4798-46b8-428f-acf2-349b84eb8a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.554860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb4798-46b8-428f-acf2-349b84eb8a9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:50.556813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb4798-46b8-428f-acf2-349b84eb8a9d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:50.577645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 22/40] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 08:00:50 2022] POST /identity/v3/roles => generated 219 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:50.579733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31612b-09bd-4bf6-b287-6d847041cf3c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.580230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31612b-09bd-4bf6-b287-6d847041cf3c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.580761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31612b-09bd-4bf6-b287-6d847041cf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.607057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1e31612b-09bd-4bf6-b287-6d847041cf3c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:50.608960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1e31612b-09bd-4bf6-b287-6d847041cf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:50.612519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:50.622076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303f8b7-bef7-4d9f-a456-0b1359ce621d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:50.706826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 23/41] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:50.708083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31612b-09bd-4bf6-b287-6d847041cf3c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:50.823807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98acc4c-72fb-4269-a0d9-230af9a34172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:50.824474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98acc4c-72fb-4269-a0d9-230af9a34172 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.824770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98acc4c-72fb-4269-a0d9-230af9a34172 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.825051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98acc4c-72fb-4269-a0d9-230af9a34172 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.826668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98acc4c-72fb-4269-a0d9-230af9a34172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:50.830887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98acc4c-72fb-4269-a0d9-230af9a34172 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:50.834361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 19/42] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:50.840337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98acc4c-72fb-4269-a0d9-230af9a34172 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:50.879026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31612b-09bd-4bf6-b287-6d847041cf3c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:50.909081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:50.927476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254f4e-d8b2-4047-aab1-0ac5372b1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:50.928574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254f4e-d8b2-4047-aab1-0ac5372b1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:50.929122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254f4e-d8b2-4047-aab1-0ac5372b1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:50.929671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254f4e-d8b2-4047-aab1-0ac5372b1ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:50.932576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff254f4e-d8b2-4047-aab1-0ac5372b1ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:50.935262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff254f4e-d8b2-4047-aab1-0ac5372b1ec1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:50.938123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 24/43] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:50.947773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254f4e-d8b2-4047-aab1-0ac5372b1ec1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:50.962749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:50.997737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98acc4c-72fb-4269-a0d9-230af9a34172 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:51.043023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d70b0-d22c-4fb9-878e-ee221f975886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:51.043889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d70b0-d22c-4fb9-878e-ee221f975886 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:51.044297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d70b0-d22c-4fb9-878e-ee221f975886 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:51.044692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d70b0-d22c-4fb9-878e-ee221f975886 None admin] PATH_INFO: `/v3/domains/default/users/d2d8becce6b1469fa561088c062a1608/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:51.047140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d70b0-d22c-4fb9-878e-ee221f975886 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d2d8becce6b1469fa561088c062a1608, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:51.048816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d70b0-d22c-4fb9-878e-ee221f975886 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:51.068148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 20/44] 10.222.0.43 () {58 vars in 1361 bytes} [Thu Sep 1 08:00:50 2022] PUT /identity/v3/domains/default/users/d2d8becce6b1469fa561088c062a1608/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:00:51.069510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d70b0-d22c-4fb9-878e-ee221f975886 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:51.124485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254f4e-d8b2-4047-aab1-0ac5372b1ec1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:51.173390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e812a-558c-48f9-a3a1-33ac50fe7f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:51.174858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e812a-558c-48f9-a3a1-33ac50fe7f91 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:51.175398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e812a-558c-48f9-a3a1-33ac50fe7f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:51.175972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e812a-558c-48f9-a3a1-33ac50fe7f91 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:51.176872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e812a-558c-48f9-a3a1-33ac50fe7f91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:51.178883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e812a-558c-48f9-a3a1-33ac50fe7f91 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:51.220071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 25/45] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:00:50 2022] POST /identity/v3/projects => generated 312 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:00:51.265451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d70b0-d22c-4fb9-878e-ee221f975886 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:51.272094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:51.328987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c8c1-71d2-4765-9061-d0103d0a6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:51.329824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c8c1-71d2-4765-9061-d0103d0a6396 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:51.330386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c8c1-71d2-4765-9061-d0103d0a6396 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:51.330814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c8c1-71d2-4765-9061-d0103d0a6396 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:51.331649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77c8c1-71d2-4765-9061-d0103d0a6396 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:51.333223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77c8c1-71d2-4765-9061-d0103d0a6396 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:51.354110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 21/46] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 08:00:51 2022] POST /identity/v3/roles => generated 223 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:53.281228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16dc1-77f7-463d-8b13-ede7744e67c9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.282038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16dc1-77f7-463d-8b13-ede7744e67c9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.282038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16dc1-77f7-463d-8b13-ede7744e67c9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.283173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 26/47] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:53.292994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e29679-3516-41b5-8b01-3fe5b12483cb None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.293580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e29679-3516-41b5-8b01-3fe5b12483cb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.293948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e29679-3516-41b5-8b01-3fe5b12483cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.324838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-16e29679-3516-41b5-8b01-3fe5b12483cb None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:53.327710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-16e29679-3516-41b5-8b01-3fe5b12483cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:53.414951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 22/48] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:53.458101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb484-744a-497d-ada7-7d98f4d0e463 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.458608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb484-744a-497d-ada7-7d98f4d0e463 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.458717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb484-744a-497d-ada7-7d98f4d0e463 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.460061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 27/49] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:53.467544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a33e8-a249-4045-b780-6ec5aa94976e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.468028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a33e8-a249-4045-b780-6ec5aa94976e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.468502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a33e8-a249-4045-b780-6ec5aa94976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.493165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2a7a33e8-a249-4045-b780-6ec5aa94976e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:53.494933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2a7a33e8-a249-4045-b780-6ec5aa94976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:53.578061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 23/50] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:53.695412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb484-744a-497d-ada7-7d98f4d0e463 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.768733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:53.826105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb484-744a-497d-ada7-7d98f4d0e463 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:53.884227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6a4b3-970a-43b8-859b-6aebb93e8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:53.885636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a4b3-970a-43b8-859b-6aebb93e8c42 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.886121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a4b3-970a-43b8-859b-6aebb93e8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.886634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a4b3-970a-43b8-859b-6aebb93e8c42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.894248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a33e8-a249-4045-b780-6ec5aa94976e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.903836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6a4b3-970a-43b8-859b-6aebb93e8c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1bd6a4b3-970a-43b8-859b-6aebb93e8c42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:53.911570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:53.913104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:00:53.915111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 28/51] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:53.920595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6a4b3-970a-43b8-859b-6aebb93e8c42 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.928449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.037280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a33e8-a249-4045-b780-6ec5aa94976e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.080674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaabfdc-b682-4225-a0ee-33cacb7bcda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.081333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaabfdc-b682-4225-a0ee-33cacb7bcda1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.081617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaabfdc-b682-4225-a0ee-33cacb7bcda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.081893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaabfdc-b682-4225-a0ee-33cacb7bcda1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.083195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaabfdc-b682-4225-a0ee-33cacb7bcda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.084722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaabfdc-b682-4225-a0ee-33cacb7bcda1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.086474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 24/52] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:54.093219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaabfdc-b682-4225-a0ee-33cacb7bcda1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.161765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6a4b3-970a-43b8-859b-6aebb93e8c42 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.184489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.205236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.214948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109043-41d9-4969-877c-a20309db223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.215899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109043-41d9-4969-877c-a20309db223b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.216360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109043-41d9-4969-877c-a20309db223b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.216874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109043-41d9-4969-877c-a20309db223b None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.217344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaabfdc-b682-4225-a0ee-33cacb7bcda1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.218090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c109043-41d9-4969-877c-a20309db223b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:54.218699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c109043-41d9-4969-877c-a20309db223b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.221416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c109043-41d9-4969-877c-a20309db223b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.243086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 29/53] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:54.250034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109043-41d9-4969-877c-a20309db223b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.254465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76c9c7-aed5-4446-a5ed-67a26efaa66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.255081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c9c7-aed5-4446-a5ed-67a26efaa66f None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.255363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c9c7-aed5-4446-a5ed-67a26efaa66f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.255638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c9c7-aed5-4446-a5ed-67a26efaa66f None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.256321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76c9c7-aed5-4446-a5ed-67a26efaa66f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.257787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76c9c7-aed5-4446-a5ed-67a26efaa66f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.293201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 25/54] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Sep 1 08:00:54 2022] POST /identity/v3/projects => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:00:54.387772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109043-41d9-4969-877c-a20309db223b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.435148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc86c-d0fc-4a78-80df-2ecf494422ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.435864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc86c-d0fc-4a78-80df-2ecf494422ec None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.436240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc86c-d0fc-4a78-80df-2ecf494422ec None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.436602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc86c-d0fc-4a78-80df-2ecf494422ec None admin] PATH_INFO: `/v3/users/d2d8becce6b1469fa561088c062a1608` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.444118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bc86c-d0fc-4a78-80df-2ecf494422ec None admin] RBAC: Authorizing `identity:get_user(user_id=d2d8becce6b1469fa561088c062a1608)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.447664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bc86c-d0fc-4a78-80df-2ecf494422ec None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.456495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 30/55] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/users/d2d8becce6b1469fa561088c062a1608 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:54.457902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76c9c7-aed5-4446-a5ed-67a26efaa66f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.605753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76c9c7-aed5-4446-a5ed-67a26efaa66f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.664781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a3341-2f1e-4626-8fb9-0655d7df3af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.665912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3341-2f1e-4626-8fb9-0655d7df3af1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.666590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3341-2f1e-4626-8fb9-0655d7df3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.667034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3341-2f1e-4626-8fb9-0655d7df3af1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.668970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a3341-2f1e-4626-8fb9-0655d7df3af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.671672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a3341-2f1e-4626-8fb9-0655d7df3af1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.679540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 26/56] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:54.680940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc86c-d0fc-4a78-80df-2ecf494422ec None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.744090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.807006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc86c-d0fc-4a78-80df-2ecf494422ec None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.850975 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930365dd-35d7-4a44-8e6f-938f4a120d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.851620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930365dd-35d7-4a44-8e6f-938f4a120d03 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.851902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930365dd-35d7-4a44-8e6f-938f4a120d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.852180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930365dd-35d7-4a44-8e6f-938f4a120d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.852948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930365dd-35d7-4a44-8e6f-938f4a120d03 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.domain.id=default, user.id=d2d8becce6b1469fa561088c062a1608) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:54.853855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930365dd-35d7-4a44-8e6f-938f4a120d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.855539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930365dd-35d7-4a44-8e6f-938f4a120d03 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.866127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 31/57] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/role_assignments?user.id=d2d8becce6b1469fa561088c062a1608&scope.domain.id=default&role.id=b76f0bbd02794923b10af161becac1c6 => generated 530 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:56.435271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310146ee-2938-483a-98d5-9a0c4caa363a None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.435803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310146ee-2938-483a-98d5-9a0c4caa363a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.435931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310146ee-2938-483a-98d5-9a0c4caa363a None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.437369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 27/58] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:56.444109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5124cff-75b3-4914-b97d-8b617aa1b681 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.444618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5124cff-75b3-4914-b97d-8b617aa1b681 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.444732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5124cff-75b3-4914-b97d-8b617aa1b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.464832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e5124cff-75b3-4914-b97d-8b617aa1b681 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:56.466084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e5124cff-75b3-4914-b97d-8b617aa1b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:56.544142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:56.826588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310146ee-2938-483a-98d5-9a0c4caa363a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:56.843203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:56.940187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310146ee-2938-483a-98d5-9a0c4caa363a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:56.975545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4c27d-c9bc-4acf-877c-597d70be96f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:56.976188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4c27d-c9bc-4acf-877c-597d70be96f2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.976474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4c27d-c9bc-4acf-877c-597d70be96f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.976752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4c27d-c9bc-4acf-877c-597d70be96f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.977894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4c27d-c9bc-4acf-877c-597d70be96f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:56.979847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4c27d-c9bc-4acf-877c-597d70be96f2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:56.981482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 28/60] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:56.987485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5124cff-75b3-4914-b97d-8b617aa1b681 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:57.034410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:57.104433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5124cff-75b3-4914-b97d-8b617aa1b681 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:57.141720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7a67d-913a-4b76-b6b1-0fc198c7f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:57.142371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7a67d-913a-4b76-b6b1-0fc198c7f4ae None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:57.142660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7a67d-913a-4b76-b6b1-0fc198c7f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:57.142942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7a67d-913a-4b76-b6b1-0fc198c7f4ae None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:57.143619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7a67d-913a-4b76-b6b1-0fc198c7f4ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:57.145088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7a67d-913a-4b76-b6b1-0fc198c7f4ae None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:57.175269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 33/61] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:00:56 2022] POST /identity/v3/users => generated 275 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:01:01.013609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb8116-02db-4fb1-a53f-d27b4270e429 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.015200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb8116-02db-4fb1-a53f-d27b4270e429 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.015967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb8116-02db-4fb1-a53f-d27b4270e429 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.018812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 29/62] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:01.029266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde8e55-f2b0-418e-a8cc-6f03aec1407c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.030794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde8e55-f2b0-418e-a8cc-6f03aec1407c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.031584 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde8e55-f2b0-418e-a8cc-6f03aec1407c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.073088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bdde8e55-f2b0-418e-a8cc-6f03aec1407c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:01.075670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bdde8e55-f2b0-418e-a8cc-6f03aec1407c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:01.246606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 34/63] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:01.686898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ea16-ad3b-4c03-8d13-11233b438ebb None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.687585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ea16-ad3b-4c03-8d13-11233b438ebb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.688072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ea16-ad3b-4c03-8d13-11233b438ebb None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.689978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 30/64] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:01.695322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e32eb-c3ef-43cb-a097-63d365809147 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.696000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e32eb-c3ef-43cb-a097-63d365809147 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.696475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e32eb-c3ef-43cb-a097-63d365809147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.726868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-703e32eb-c3ef-43cb-a097-63d365809147 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:01.728441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-703e32eb-c3ef-43cb-a097-63d365809147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:01.776806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ea16-ad3b-4c03-8d13-11233b438ebb None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:01.786545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:01.909640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:01.925183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 35/65] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:01.926994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29970e-efa7-4da6-9c71-23f6bedc8dce None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.927468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29970e-efa7-4da6-9c71-23f6bedc8dce None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.927895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29970e-efa7-4da6-9c71-23f6bedc8dce None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.934709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 36/66] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:01.940666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554822bd-ed86-42a1-b5b6-c7b8e2761f16 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.941181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554822bd-ed86-42a1-b5b6-c7b8e2761f16 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.941614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554822bd-ed86-42a1-b5b6-c7b8e2761f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.955057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ea16-ad3b-4c03-8d13-11233b438ebb None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:01.985601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-554822bd-ed86-42a1-b5b6-c7b8e2761f16 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:01.987106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-554822bd-ed86-42a1-b5b6-c7b8e2761f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:02.035810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514e23a-8192-4a6b-bb5b-e55997fad9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.038054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e23a-8192-4a6b-bb5b-e55997fad9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.038775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e23a-8192-4a6b-bb5b-e55997fad9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.039582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e23a-8192-4a6b-bb5b-e55997fad9c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.066340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514e23a-8192-4a6b-bb5b-e55997fad9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-2514e23a-8192-4a6b-bb5b-e55997fad9c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:02.079230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:02.081155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:02.082898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:02.087527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 31/67] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:01:02.095889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514e23a-8192-4a6b-bb5b-e55997fad9c5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.183259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 37/68] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 08:01:02.186784 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aa190-16be-4bcf-b643-8e8cf239c5ef None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.187577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aa190-16be-4bcf-b643-8e8cf239c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.188286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aa190-16be-4bcf-b643-8e8cf239c5ef None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.191619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 38/69] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:02.194590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe96a-d80c-49ac-ac74-ee232d123ae2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.195402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe96a-d80c-49ac-ac74-ee232d123ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.196585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe96a-d80c-49ac-ac74-ee232d123ae2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.200639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 39/70] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:02.203833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfe875-ebad-40b9-a046-c3f9486596f6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.204930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfe875-ebad-40b9-a046-c3f9486596f6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.205640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfe875-ebad-40b9-a046-c3f9486596f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.235239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6bbfe875-ebad-40b9-a046-c3f9486596f6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:02.238666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6bbfe875-ebad-40b9-a046-c3f9486596f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:02.326717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514e23a-8192-4a6b-bb5b-e55997fad9c5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.374943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 40/71] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:02.376899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a751c0-1fb8-4fd5-a31b-2e1372f7dea0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.377330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a751c0-1fb8-4fd5-a31b-2e1372f7dea0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.377733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a751c0-1fb8-4fd5-a31b-2e1372f7dea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.397139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.398728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.399460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.400223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.402319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:02.403123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:02.405927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:02.410708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-25a751c0-1fb8-4fd5-a31b-2e1372f7dea0 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:02.412696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-25a751c0-1fb8-4fd5-a31b-2e1372f7dea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:02.424393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 32/72] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:02.426395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.433551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.449361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.544765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 41/73] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:02.546192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a751c0-1fb8-4fd5-a31b-2e1372f7dea0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.607127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d2bc-3913-4c2b-a47a-f3ea94a978b2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.674349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a836fb-e453-403b-ad40-58aabc5673f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.675654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a836fb-e453-403b-ad40-58aabc5673f4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.676508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a836fb-e453-403b-ad40-58aabc5673f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.677145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a836fb-e453-403b-ad40-58aabc5673f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.679962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a836fb-e453-403b-ad40-58aabc5673f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:02.684207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a836fb-e453-403b-ad40-58aabc5673f4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:02.694151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 33/74] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:02.695876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a836fb-e453-403b-ad40-58aabc5673f4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.749788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a751c0-1fb8-4fd5-a31b-2e1372f7dea0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.808943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ec3d-8e34-44c0-95a3-727847f4ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.809778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ec3d-8e34-44c0-95a3-727847f4ac42 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.810242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ec3d-8e34-44c0-95a3-727847f4ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.810802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ec3d-8e34-44c0-95a3-727847f4ac42 None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.822802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.837322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ec3d-8e34-44c0-95a3-727847f4ac42 None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:02.840511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ec3d-8e34-44c0-95a3-727847f4ac42 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:02.843240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 42/75] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:02.844626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ec3d-8e34-44c0-95a3-727847f4ac42 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.860613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.883360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a836fb-e453-403b-ad40-58aabc5673f4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.934711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd980-8f40-4102-aa80-57404a728f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.935726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd980-8f40-4102-aa80-57404a728f1e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.936241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd980-8f40-4102-aa80-57404a728f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.936715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd980-8f40-4102-aa80-57404a728f1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.949843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd980-8f40-4102-aa80-57404a728f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d2acd980-8f40-4102-aa80-57404a728f1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:02.955652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:02.956575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:02.957335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 34/76] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:02.957974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd980-8f40-4102-aa80-57404a728f1e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.987607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ec3d-8e34-44c0-95a3-727847f4ac42 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.047678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead782-abe4-4c6c-8306-8aa45a669c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.049103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead782-abe4-4c6c-8306-8aa45a669c7c None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.049841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead782-abe4-4c6c-8306-8aa45a669c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.050870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead782-abe4-4c6c-8306-8aa45a669c7c None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.051737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ead782-abe4-4c6c-8306-8aa45a669c7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.054611 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ead782-abe4-4c6c-8306-8aa45a669c7c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.083015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd980-8f40-4102-aa80-57404a728f1e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.086282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 43/77] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:02 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:03.087746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead782-abe4-4c6c-8306-8aa45a669c7c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.120812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.132211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac386455-0704-4da9-b284-0c7b141e1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.133061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386455-0704-4da9-b284-0c7b141e1f55 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.133353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386455-0704-4da9-b284-0c7b141e1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.133635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386455-0704-4da9-b284-0c7b141e1f55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.151494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac386455-0704-4da9-b284-0c7b141e1f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-ac386455-0704-4da9-b284-0c7b141e1f55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:03.161534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:03.162818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:03.163583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 35/78] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:03.165025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac386455-0704-4da9-b284-0c7b141e1f55 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.197028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.265905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead782-abe4-4c6c-8306-8aa45a669c7c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.317190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60cc7-ba00-46f9-9185-c9e6d5d69b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.317190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60cc7-ba00-46f9-9185-c9e6d5d69b9e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.317190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60cc7-ba00-46f9-9185-c9e6d5d69b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.317190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60cc7-ba00-46f9-9185-c9e6d5d69b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.330466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac386455-0704-4da9-b284-0c7b141e1f55 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.389260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.389895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.390244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.390608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.391341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:03.391663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.393093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.406013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 36/79] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:03.407850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.459159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc60cc7-ba00-46f9-9185-c9e6d5d69b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.462186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc60cc7-ba00-46f9-9185-c9e6d5d69b9e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.510461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.572881 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.588783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438696c-c092-4590-b221-5e9986a9b5d8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.624852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 44/80] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:03.625926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60cc7-ba00-46f9-9185-c9e6d5d69b9e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.668146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603296d5-5794-4a20-b22f-6c5048c80bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.669307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603296d5-5794-4a20-b22f-6c5048c80bbd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.669894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603296d5-5794-4a20-b22f-6c5048c80bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.670452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603296d5-5794-4a20-b22f-6c5048c80bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.690932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603296d5-5794-4a20-b22f-6c5048c80bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-603296d5-5794-4a20-b22f-6c5048c80bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:03.696971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:03.698524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:03.699269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:03.701599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 37/81] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:03.707420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603296d5-5794-4a20-b22f-6c5048c80bbd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.788815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60cc7-ba00-46f9-9185-c9e6d5d69b9e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.834969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.836226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.836730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.837238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.838799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:03.839338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.841019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.851262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 45/82] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:03.852575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.863276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603296d5-5794-4a20-b22f-6c5048c80bbd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.885181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.888304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.922709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103bd05-0085-4382-b56d-52e78bdb37c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.923409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bd05-0085-4382-b56d-52e78bdb37c7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.923705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bd05-0085-4382-b56d-52e78bdb37c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.923990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103bd05-0085-4382-b56d-52e78bdb37c7 None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.925601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103bd05-0085-4382-b56d-52e78bdb37c7 None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.927430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103bd05-0085-4382-b56d-52e78bdb37c7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.929623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 38/83] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:03.930523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103bd05-0085-4382-b56d-52e78bdb37c7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.000082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5fe8e-9912-4f73-b358-937839f969a9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.042064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47d577-4a5e-41e9-8143-451fc80412e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.042832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47d577-4a5e-41e9-8143-451fc80412e1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.043122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47d577-4a5e-41e9-8143-451fc80412e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.043401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47d577-4a5e-41e9-8143-451fc80412e1 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.044780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47d577-4a5e-41e9-8143-451fc80412e1 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.046241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47d577-4a5e-41e9-8143-451fc80412e1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.048089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 46/84] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.053882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47d577-4a5e-41e9-8143-451fc80412e1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.078644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103bd05-0085-4382-b56d-52e78bdb37c7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.130198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.131657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.132414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.132873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.134473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:04.135779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.137702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.152866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 39/85] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.152866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.172002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.186655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47d577-4a5e-41e9-8143-451fc80412e1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.201320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.235201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640729e7-9b72-422d-a569-0c7d39f5833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.237286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640729e7-9b72-422d-a569-0c7d39f5833b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.237765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640729e7-9b72-422d-a569-0c7d39f5833b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.238195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640729e7-9b72-422d-a569-0c7d39f5833b None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.239643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640729e7-9b72-422d-a569-0c7d39f5833b None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.241529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640729e7-9b72-422d-a569-0c7d39f5833b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.243924 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 47/86] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.245892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640729e7-9b72-422d-a569-0c7d39f5833b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.288307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad82818-dc5e-4f09-997f-0b7fee7cb918 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.357249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c76b-5fce-42b8-aefa-105fb9b65334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.358670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c76b-5fce-42b8-aefa-105fb9b65334 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.359543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c76b-5fce-42b8-aefa-105fb9b65334 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.360401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c76b-5fce-42b8-aefa-105fb9b65334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.375137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640729e7-9b72-422d-a569-0c7d39f5833b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.419564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.420333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.420677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.421027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.421887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] RBAC: Adding query filter params (role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=eac39512f21849eda95175d1d3af66de, user.id=0036e4fc61fc440984148b32ad39f535) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:04.422327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.424134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.430838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 48/87] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/role_assignments?user.id=0036e4fc61fc440984148b32ad39f535&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=af32346e85724870afa2c6aee5b285ed => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.440558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.488310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0c76b-5fce-42b8-aefa-105fb9b65334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.490152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0c76b-5fce-42b8-aefa-105fb9b65334 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.496851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.548167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.624830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 40/88] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:04.626000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c76b-5fce-42b8-aefa-105fb9b65334 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.671238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec4492-30d5-4334-9722-31fdf07f20ef None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.738197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cff30-b12d-43a7-9518-77b244306b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.738806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cff30-b12d-43a7-9518-77b244306b2e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.739093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cff30-b12d-43a7-9518-77b244306b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.739381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cff30-b12d-43a7-9518-77b244306b2e None admin] PATH_INFO: `/v3/users/d2d8becce6b1469fa561088c062a1608` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.743192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cff30-b12d-43a7-9518-77b244306b2e None admin] RBAC: Authorizing `identity:get_user(user_id=d2d8becce6b1469fa561088c062a1608)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.744921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cff30-b12d-43a7-9518-77b244306b2e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.746842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 49/89] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/users/d2d8becce6b1469fa561088c062a1608 => generated 247 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.747586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cff30-b12d-43a7-9518-77b244306b2e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.752864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c76b-5fce-42b8-aefa-105fb9b65334 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.798831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f50eb-97bf-4b37-a5b5-2c75a5a9ad4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.799818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f50eb-97bf-4b37-a5b5-2c75a5a9ad4a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.800327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f50eb-97bf-4b37-a5b5-2c75a5a9ad4a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.800818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f50eb-97bf-4b37-a5b5-2c75a5a9ad4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.816228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.889607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f50eb-97bf-4b37-a5b5-2c75a5a9ad4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.891847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f50eb-97bf-4b37-a5b5-2c75a5a9ad4a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.907728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.918424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cff30-b12d-43a7-9518-77b244306b2e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.969583 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4516d-1352-4d43-9eef-5242d8aa09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.970247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4516d-1352-4d43-9eef-5242d8aa09af None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.970559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4516d-1352-4d43-9eef-5242d8aa09af None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.970845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4516d-1352-4d43-9eef-5242d8aa09af None admin] PATH_INFO: `/v3/projects/e9fd56c023714538aa129531f987fced` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.972117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4516d-1352-4d43-9eef-5242d8aa09af None admin] RBAC: Authorizing `identity:get_project(project_id=e9fd56c023714538aa129531f987fced)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.973742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4516d-1352-4d43-9eef-5242d8aa09af None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.975482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 50/90] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/projects/e9fd56c023714538aa129531f987fced => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.976288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4516d-1352-4d43-9eef-5242d8aa09af None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.019271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 41/91] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:05.020613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f50eb-97bf-4b37-a5b5-2c75a5a9ad4a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.109238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.198338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4516d-1352-4d43-9eef-5242d8aa09af None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.229140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f50eb-97bf-4b37-a5b5-2c75a5a9ad4a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.232147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fbd2e-7241-4b2b-a6c3-3d4c087a078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.232748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fbd2e-7241-4b2b-a6c3-3d4c087a078a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.233033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fbd2e-7241-4b2b-a6c3-3d4c087a078a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.233320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fbd2e-7241-4b2b-a6c3-3d4c087a078a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.265925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.306180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.307291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.307934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.308417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.309533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] RBAC: Adding query filter params (role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=e9fd56c023714538aa129531f987fced, user.id=0036e4fc61fc440984148b32ad39f535) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:05.310056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.311415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fbd2e-7241-4b2b-a6c3-3d4c087a078a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.312050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.312900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fbd2e-7241-4b2b-a6c3-3d4c087a078a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.325844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 42/92] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/role_assignments?user.id=0036e4fc61fc440984148b32ad39f535&scope.project.id=e9fd56c023714538aa129531f987fced&role.id=af32346e85724870afa2c6aee5b285ed => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:05.327116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.427735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 51/93] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:05.434504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fbd2e-7241-4b2b-a6c3-3d4c087a078a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.491123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764b46e-76a1-4be8-8bee-1362cb67c179 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.500798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.507364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.539857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cfd41-12e0-4942-bd78-5ddd28e48573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.540953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cfd41-12e0-4942-bd78-5ddd28e48573 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.542125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cfd41-12e0-4942-bd78-5ddd28e48573 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.542819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cfd41-12e0-4942-bd78-5ddd28e48573 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.544448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cfd41-12e0-4942-bd78-5ddd28e48573 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.546554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cfd41-12e0-4942-bd78-5ddd28e48573 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.548738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 43/94] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:05.556061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fbd2e-7241-4b2b-a6c3-3d4c087a078a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.560682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cfd41-12e0-4942-bd78-5ddd28e48573 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.599605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff5b51-463f-46d0-acad-588412c31344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.600426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff5b51-463f-46d0-acad-588412c31344 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.601422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff5b51-463f-46d0-acad-588412c31344 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.601422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff5b51-463f-46d0-acad-588412c31344 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.602682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff5b51-463f-46d0-acad-588412c31344 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.604867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff5b51-463f-46d0-acad-588412c31344 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.611002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 52/95] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:05.613429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff5b51-463f-46d0-acad-588412c31344 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.743992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff5b51-463f-46d0-acad-588412c31344 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.783141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.796585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59bf94-9876-435f-951d-a8dab11fdba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.797511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59bf94-9876-435f-951d-a8dab11fdba7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.799213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59bf94-9876-435f-951d-a8dab11fdba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.799523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59bf94-9876-435f-951d-a8dab11fdba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.800626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59bf94-9876-435f-951d-a8dab11fdba7 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=eac39512f21849eda95175d1d3af66de, user.id=d2d8becce6b1469fa561088c062a1608) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:05.800952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59bf94-9876-435f-951d-a8dab11fdba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.803031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59bf94-9876-435f-951d-a8dab11fdba7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.805434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cfd41-12e0-4942-bd78-5ddd28e48573 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.814078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 53/96] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/role_assignments?user.id=d2d8becce6b1469fa561088c062a1608&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=b76f0bbd02794923b10af161becac1c6 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:05.819422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc9c4-86b0-48dc-af40-ff74f6d7a35b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.819809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc9c4-86b0-48dc-af40-ff74f6d7a35b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.820161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cc9c4-86b0-48dc-af40-ff74f6d7a35b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.825179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 54/97] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:05.830953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40916c-9cb1-40ac-acf7-2ef58162b202 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.831333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40916c-9cb1-40ac-acf7-2ef58162b202 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.831683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40916c-9cb1-40ac-acf7-2ef58162b202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.866122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8e40916c-9cb1-40ac-acf7-2ef58162b202 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:05.870771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8e40916c-9cb1-40ac-acf7-2ef58162b202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:05.889009 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846e97a-5fa3-46b1-8d37-1abbaa332d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.889784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e97a-5fa3-46b1-8d37-1abbaa332d20 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.890148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e97a-5fa3-46b1-8d37-1abbaa332d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.890538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e97a-5fa3-46b1-8d37-1abbaa332d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.891370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846e97a-5fa3-46b1-8d37-1abbaa332d20 None admin] RBAC: Adding query filter params (role.id=664110d895074b5a89855c373f794807, scope.project.id=eac39512f21849eda95175d1d3af66de, user.id=0036e4fc61fc440984148b32ad39f535) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:05.893579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846e97a-5fa3-46b1-8d37-1abbaa332d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.896244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846e97a-5fa3-46b1-8d37-1abbaa332d20 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.911470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 44/98] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/role_assignments?user.id=0036e4fc61fc440984148b32ad39f535&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=664110d895074b5a89855c373f794807 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:05.980789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 55/99] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:06.080047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703c39-d7de-40ee-b32c-78b64dcae2f2 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.080366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703c39-d7de-40ee-b32c-78b64dcae2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.080701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703c39-d7de-40ee-b32c-78b64dcae2f2 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.082180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 45/100] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:06.088403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef548-8a94-4dda-8a34-5581ba53cf77 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.088817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef548-8a94-4dda-8a34-5581ba53cf77 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.089520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef548-8a94-4dda-8a34-5581ba53cf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.122308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e83ef548-8a94-4dda-8a34-5581ba53cf77 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:06.123564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e83ef548-8a94-4dda-8a34-5581ba53cf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:06.217550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 56/101] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:06.471199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82703c39-d7de-40ee-b32c-78b64dcae2f2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.566363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:06.625814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef548-8a94-4dda-8a34-5581ba53cf77 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.706820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82703c39-d7de-40ee-b32c-78b64dcae2f2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:06.717741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:06.780239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef548-8a94-4dda-8a34-5581ba53cf77 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:06.822043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698cc3a-06ca-4e10-b277-7eb29e892ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:06.823735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698cc3a-06ca-4e10-b277-7eb29e892ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.824235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698cc3a-06ca-4e10-b277-7eb29e892ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.824829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698cc3a-06ca-4e10-b277-7eb29e892ac3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.827182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f1282-cc1f-4e52-ab1c-614f6508df50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:06.827735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f1282-cc1f-4e52-ab1c-614f6508df50 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.828035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f1282-cc1f-4e52-ab1c-614f6508df50 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.828324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f1282-cc1f-4e52-ab1c-614f6508df50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.833850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f1282-cc1f-4e52-ab1c-614f6508df50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:06.835427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f1282-cc1f-4e52-ab1c-614f6508df50 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:06.837133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 46/102] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:06.840261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698cc3a-06ca-4e10-b277-7eb29e892ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:06.843949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f1282-cc1f-4e52-ab1c-614f6508df50 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8698cc3a-06ca-4e10-b277-7eb29e892ac3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:06.846122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:06.847001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:06.847759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:06.850597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 57/103] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:06.859316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698cc3a-06ca-4e10-b277-7eb29e892ac3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:07.101271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f1282-cc1f-4e52-ab1c-614f6508df50 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:07.110293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698cc3a-06ca-4e10-b277-7eb29e892ac3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:07.121596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:07.130209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:07.159814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:07.160803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:07.161308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:07.161799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:07.162709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:07.163215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:07.164815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:07.176709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 58/104] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:07.186076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:07.215458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb189291-c87c-47a1-b5da-be8e5c26d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:07.216756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb189291-c87c-47a1-b5da-be8e5c26d6b3 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:07.217291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb189291-c87c-47a1-b5da-be8e5c26d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:07.218021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb189291-c87c-47a1-b5da-be8e5c26d6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:07.219393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb189291-c87c-47a1-b5da-be8e5c26d6b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:07.221097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb189291-c87c-47a1-b5da-be8e5c26d6b3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:07.260565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 47/105] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:01:06 2022] POST /identity/v3/projects => generated 302 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:07.347128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f43ddc-a0c5-429c-9f84-b18d0524087e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:07.389024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5697-8fd1-4fd2-8343-8a7baa8a5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:07.390152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5697-8fd1-4fd2-8343-8a7baa8a5dff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:07.390785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5697-8fd1-4fd2-8343-8a7baa8a5dff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:07.391266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5697-8fd1-4fd2-8343-8a7baa8a5dff None admin] PATH_INFO: `/v3/users/e4fdf0da826442a1b9a879c68d7e98a2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:07.409284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d5697-8fd1-4fd2-8343-8a7baa8a5dff None admin] RBAC: Authorizing `identity:get_user(user_id=e4fdf0da826442a1b9a879c68d7e98a2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:07.411173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d5697-8fd1-4fd2-8343-8a7baa8a5dff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:07.413142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 59/106] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:07 2022] GET /identity/v3/users/e4fdf0da826442a1b9a879c68d7e98a2 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:07.422171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb189291-c87c-47a1-b5da-be8e5c26d6b3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:07.569515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb189291-c87c-47a1-b5da-be8e5c26d6b3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:07.624349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c2641-cc7f-4612-aa19-4908a02b93f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:07.625386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c2641-cc7f-4612-aa19-4908a02b93f8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:07.625872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c2641-cc7f-4612-aa19-4908a02b93f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:07.626376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c2641-cc7f-4612-aa19-4908a02b93f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:07.671965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:07.732423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c2641-cc7f-4612-aa19-4908a02b93f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:07.734354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c2641-cc7f-4612-aa19-4908a02b93f8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:07.877333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 48/107] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:01:07.884912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5697-8fd1-4fd2-8343-8a7baa8a5dff None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:07.933130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:08.036563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5697-8fd1-4fd2-8343-8a7baa8a5dff None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:08.128571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bc8df-70fd-47fc-b17f-c98076f44389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:08.130212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bc8df-70fd-47fc-b17f-c98076f44389 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.131059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bc8df-70fd-47fc-b17f-c98076f44389 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.131778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bc8df-70fd-47fc-b17f-c98076f44389 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.139751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bc8df-70fd-47fc-b17f-c98076f44389 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:08.142870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bc8df-70fd-47fc-b17f-c98076f44389 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:08.146634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 60/108] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:07 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:08.155711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c2641-cc7f-4612-aa19-4908a02b93f8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:08.254780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:08.311228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c2641-cc7f-4612-aa19-4908a02b93f8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:08.367890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fd4bb-57b3-488a-a24b-67db7c46406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:08.368901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fd4bb-57b3-488a-a24b-67db7c46406e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.369746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fd4bb-57b3-488a-a24b-67db7c46406e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.370244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fd4bb-57b3-488a-a24b-67db7c46406e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.371229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fd4bb-57b3-488a-a24b-67db7c46406e None admin] RBAC: Adding query filter params (role.id=17ed2a44e14a4da180fe4f88ed7568b3, scope.project.id=eac39512f21849eda95175d1d3af66de, user.id=e4fdf0da826442a1b9a879c68d7e98a2) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:08.371778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fd4bb-57b3-488a-a24b-67db7c46406e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:08.373463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fd4bb-57b3-488a-a24b-67db7c46406e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:08.383205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 49/109] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:08 2022] GET /identity/v3/role_assignments?user.id=e4fdf0da826442a1b9a879c68d7e98a2&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=17ed2a44e14a4da180fe4f88ed7568b3 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:08.597360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5a3d-d683-40c9-bcbc-b2ca21b86d93 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.597715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5a3d-d683-40c9-bcbc-b2ca21b86d93 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.597931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5a3d-d683-40c9-bcbc-b2ca21b86d93 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.599516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 61/110] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:08.612594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967032c-cbb7-4e2e-9ebb-c3ea007e89e5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.613127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967032c-cbb7-4e2e-9ebb-c3ea007e89e5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.613127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967032c-cbb7-4e2e-9ebb-c3ea007e89e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.643547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3967032c-cbb7-4e2e-9ebb-c3ea007e89e5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:08.645035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3967032c-cbb7-4e2e-9ebb-c3ea007e89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:08.751080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 50/111] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:08.943360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d648194-166a-4176-87ee-773cea01b407 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.943848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d648194-166a-4176-87ee-773cea01b407 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.943848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d648194-166a-4176-87ee-773cea01b407 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.945203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 62/112] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:08.962514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2affd-b650-4418-bc59-c300235a1eb2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.962815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2affd-b650-4418-bc59-c300235a1eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.963616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2affd-b650-4418-bc59-c300235a1eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.997773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-53e2affd-b650-4418-bc59-c300235a1eb2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:09.002288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-53e2affd-b650-4418-bc59-c300235a1eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:09.163007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:09.203430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d648194-166a-4176-87ee-773cea01b407 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:09.223585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 51/113] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:09.434699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:09.443133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d648194-166a-4176-87ee-773cea01b407 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:09.541826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d35da6-2da0-4d10-a182-efd033d118e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:09.542780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d35da6-2da0-4d10-a182-efd033d118e3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.543073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d35da6-2da0-4d10-a182-efd033d118e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.543360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d35da6-2da0-4d10-a182-efd033d118e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.562194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2f2d-0004-4024-8503-de51df67518e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.562534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2f2d-0004-4024-8503-de51df67518e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.562787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2f2d-0004-4024-8503-de51df67518e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.564695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 52/114] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:09.579015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d35da6-2da0-4d10-a182-efd033d118e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-69d35da6-2da0-4d10-a182-efd033d118e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:09.584775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:09.585745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:09.586597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:09.587695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 63/115] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:09.587800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908edd9-3998-4169-a19f-2fdc573afb05 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.590311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908edd9-3998-4169-a19f-2fdc573afb05 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.590311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908edd9-3998-4169-a19f-2fdc573afb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.599764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d35da6-2da0-4d10-a182-efd033d118e3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:09.639733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4908edd9-3998-4169-a19f-2fdc573afb05 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:09.641187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4908edd9-3998-4169-a19f-2fdc573afb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:09.843841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 53/116] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:09.844812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908edd9-3998-4169-a19f-2fdc573afb05 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:09.889274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d35da6-2da0-4d10-a182-efd033d118e3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:09.969131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01b389-cb06-41ad-a16b-4edd0ed22b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:09.969759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01b389-cb06-41ad-a16b-4edd0ed22b8c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.970040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01b389-cb06-41ad-a16b-4edd0ed22b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.970350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01b389-cb06-41ad-a16b-4edd0ed22b8c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.971041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01b389-cb06-41ad-a16b-4edd0ed22b8c None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:09.971354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01b389-cb06-41ad-a16b-4edd0ed22b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:09.972766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01b389-cb06-41ad-a16b-4edd0ed22b8c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:09.996902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 64/117] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:09.998145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f0384-5424-4ec2-a4ee-fe8e3c88faed None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.998465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f0384-5424-4ec2-a4ee-fe8e3c88faed None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.998748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f0384-5424-4ec2-a4ee-fe8e3c88faed None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.000040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 65/118] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:10.005913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e91f-d1e6-4f0e-92f8-fb8b2a8f37b8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.006207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e91f-d1e6-4f0e-92f8-fb8b2a8f37b8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.006518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e91f-d1e6-4f0e-92f8-fb8b2a8f37b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.037065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908edd9-3998-4169-a19f-2fdc573afb05 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.044323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-63b8e91f-d1e6-4f0e-92f8-fb8b2a8f37b8 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:10.050499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-63b8e91f-d1e6-4f0e-92f8-fb8b2a8f37b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:10.066619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:10.094766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:10.112493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53a18a-bf9b-4f6d-b60a-8cc7a0b68cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.113216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53a18a-bf9b-4f6d-b60a-8cc7a0b68cdc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.113510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53a18a-bf9b-4f6d-b60a-8cc7a0b68cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.113854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53a18a-bf9b-4f6d-b60a-8cc7a0b68cdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.142141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53a18a-bf9b-4f6d-b60a-8cc7a0b68cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-bf53a18a-bf9b-4f6d-b60a-8cc7a0b68cdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:10.149621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:10.150581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:10.152442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:10.157384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 54/119] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:10.163093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53a18a-bf9b-4f6d-b60a-8cc7a0b68cdc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.202062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 66/120] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:10.203131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e91f-d1e6-4f0e-92f8-fb8b2a8f37b8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.314639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e91f-d1e6-4f0e-92f8-fb8b2a8f37b8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.353100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.353658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.354685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.355127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.356016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:10.356349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:10.357865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:10.361517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53a18a-bf9b-4f6d-b60a-8cc7a0b68cdc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.373351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 67/121] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:10.374417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.394673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:10.433299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34547dc4-2969-48d9-b04b-5bbb6e5220e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.436503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547dc4-2969-48d9-b04b-5bbb6e5220e1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.439721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547dc4-2969-48d9-b04b-5bbb6e5220e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.440028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547dc4-2969-48d9-b04b-5bbb6e5220e1 None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.450287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34547dc4-2969-48d9-b04b-5bbb6e5220e1 None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:10.450287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34547dc4-2969-48d9-b04b-5bbb6e5220e1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:10.450531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 55/122] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:10.451808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34547dc4-2969-48d9-b04b-5bbb6e5220e1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.586529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671a55f-f5b4-42aa-9b97-2ac93f5740aa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.596237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:10.629227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc0f6-f1b7-4bb6-9e02-6bbe1b3e25ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.629783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc0f6-f1b7-4bb6-9e02-6bbe1b3e25ef None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.630070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc0f6-f1b7-4bb6-9e02-6bbe1b3e25ef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.630398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc0f6-f1b7-4bb6-9e02-6bbe1b3e25ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.643281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdc0f6-f1b7-4bb6-9e02-6bbe1b3e25ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5bbdc0f6-f1b7-4bb6-9e02-6bbe1b3e25ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:10.648408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:10.650198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 68/123] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:10.653453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc0f6-f1b7-4bb6-9e02-6bbe1b3e25ef None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.726302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34547dc4-2969-48d9-b04b-5bbb6e5220e1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.740056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:10.769302 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc0f6-f1b7-4bb6-9e02-6bbe1b3e25ef None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.805559 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26bef2-3ddb-47a9-a659-fe49beeb9206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.807895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26bef2-3ddb-47a9-a659-fe49beeb9206 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.808692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26bef2-3ddb-47a9-a659-fe49beeb9206 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.809532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26bef2-3ddb-47a9-a659-fe49beeb9206 None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.812147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26bef2-3ddb-47a9-a659-fe49beeb9206 None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:10.815407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26bef2-3ddb-47a9-a659-fe49beeb9206 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:10.817991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028cd52-cd85-4f4c-b4d6-089da1511258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.818679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028cd52-cd85-4f4c-b4d6-089da1511258 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.818970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028cd52-cd85-4f4c-b4d6-089da1511258 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.819326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028cd52-cd85-4f4c-b4d6-089da1511258 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.819996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 56/124] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:10.821643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26bef2-3ddb-47a9-a659-fe49beeb9206 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.825855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028cd52-cd85-4f4c-b4d6-089da1511258 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:10.827522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028cd52-cd85-4f4c-b4d6-089da1511258 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:10.834297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 69/125] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:10.835329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028cd52-cd85-4f4c-b4d6-089da1511258 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.952483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028cd52-cd85-4f4c-b4d6-089da1511258 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.993881 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.995135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.995594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.996079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.996782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:10.997098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:10.998543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.008588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 70/126] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:11.009120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.016675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.033115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26bef2-3ddb-47a9-a659-fe49beeb9206 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.052562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.099009 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee4a6e-959d-45f7-b287-3a72a42fcc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.100023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee4a6e-959d-45f7-b287-3a72a42fcc0b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.100532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee4a6e-959d-45f7-b287-3a72a42fcc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.101013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee4a6e-959d-45f7-b287-3a72a42fcc0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.124492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee4a6e-959d-45f7-b287-3a72a42fcc0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:11.129841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5beea6-e466-4cc3-bf8c-4532afb3e15b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-fbee4a6e-959d-45f7-b287-3a72a42fcc0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:11.134441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:11.136284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:11.137935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 57/127] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:11.139575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee4a6e-959d-45f7-b287-3a72a42fcc0b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.176535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84ea94-5894-43a8-8f86-fa216cdae2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.177198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ea94-5894-43a8-8f86-fa216cdae2bf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.177491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ea94-5894-43a8-8f86-fa216cdae2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.177773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ea94-5894-43a8-8f86-fa216cdae2bf None admin] PATH_INFO: `/v3/projects/e9fd56c023714538aa129531f987fced` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.179042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84ea94-5894-43a8-8f86-fa216cdae2bf None admin] RBAC: Authorizing `identity:get_project(project_id=e9fd56c023714538aa129531f987fced)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.180570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84ea94-5894-43a8-8f86-fa216cdae2bf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.187558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 71/128] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:11 2022] GET /identity/v3/projects/e9fd56c023714538aa129531f987fced => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:11.187558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dd34-e673-4a81-967b-92d0622d2d54 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.187558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dd34-e673-4a81-967b-92d0622d2d54 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.187558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dd34-e673-4a81-967b-92d0622d2d54 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.187558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 72/129] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:11.187558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1dd34-e673-4a81-967b-92d0622d2d54 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.277212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee4a6e-959d-45f7-b287-3a72a42fcc0b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.315413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf2e79-3b8c-449f-9206-10d5d86f3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.316094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2e79-3b8c-449f-9206-10d5d86f3c34 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.316377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2e79-3b8c-449f-9206-10d5d86f3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.316658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf2e79-3b8c-449f-9206-10d5d86f3c34 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de/users/0036e4fc61fc440984148b32ad39f535/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.318776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf2e79-3b8c-449f-9206-10d5d86f3c34 None admin] RBAC: Authorizing `identity:create_grant(project_id=eac39512f21849eda95175d1d3af66de, user_id=0036e4fc61fc440984148b32ad39f535, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.320250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf2e79-3b8c-449f-9206-10d5d86f3c34 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.330018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.341008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 58/130] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:11 2022] PUT /identity/v3/projects/eac39512f21849eda95175d1d3af66de/users/0036e4fc61fc440984148b32ad39f535/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:11.346541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf2e79-3b8c-449f-9206-10d5d86f3c34 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.397835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1dd34-e673-4a81-967b-92d0622d2d54 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.405241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.467571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53308-9e63-43a4-b00a-14f10732a750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.468567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53308-9e63-43a4-b00a-14f10732a750 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.469068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53308-9e63-43a4-b00a-14f10732a750 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.469551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de53308-9e63-43a4-b00a-14f10732a750 None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.471789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de53308-9e63-43a4-b00a-14f10732a750 None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.473548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de53308-9e63-43a4-b00a-14f10732a750 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.483915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 73/131] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:11 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:11.483915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53308-9e63-43a4-b00a-14f10732a750 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.543674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf2e79-3b8c-449f-9206-10d5d86f3c34 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.598707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e92f3-09a7-4cfb-b546-6ca273615f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.599436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e92f3-09a7-4cfb-b546-6ca273615f19 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.599710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e92f3-09a7-4cfb-b546-6ca273615f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.599996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e92f3-09a7-4cfb-b546-6ca273615f19 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.600681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e92f3-09a7-4cfb-b546-6ca273615f19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:11.600991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e92f3-09a7-4cfb-b546-6ca273615f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.602449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e92f3-09a7-4cfb-b546-6ca273615f19 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.613953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 59/132] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:11.615829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3526-6d9a-427c-ad86-2a2a45715c86 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.616253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3526-6d9a-427c-ad86-2a2a45715c86 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.617116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3526-6d9a-427c-ad86-2a2a45715c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.643300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de53308-9e63-43a4-b00a-14f10732a750 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.645088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-574f3526-6d9a-427c-ad86-2a2a45715c86 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:11.647092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-574f3526-6d9a-427c-ad86-2a2a45715c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:11.689851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c91d13-a08a-4df0-8c2f-8bd277e65d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.691366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91d13-a08a-4df0-8c2f-8bd277e65d63 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.691825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91d13-a08a-4df0-8c2f-8bd277e65d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.692240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c91d13-a08a-4df0-8c2f-8bd277e65d63 None admin] PATH_INFO: `/v3/projects/e9fd56c023714538aa129531f987fced/users/0036e4fc61fc440984148b32ad39f535/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.694567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c91d13-a08a-4df0-8c2f-8bd277e65d63 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9fd56c023714538aa129531f987fced, user_id=0036e4fc61fc440984148b32ad39f535, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.696538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c91d13-a08a-4df0-8c2f-8bd277e65d63 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.712254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.722943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 74/133] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:11 2022] PUT /identity/v3/projects/e9fd56c023714538aa129531f987fced/users/0036e4fc61fc440984148b32ad39f535/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:11.722943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786ad48-2890-48fe-b3f3-3b741fb1761c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.722943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786ad48-2890-48fe-b3f3-3b741fb1761c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.722943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786ad48-2890-48fe-b3f3-3b741fb1761c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.726567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 75/134] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:11.730296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786ad48-2890-48fe-b3f3-3b741fb1761c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.765233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 60/135] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:11.768058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3526-6d9a-427c-ad86-2a2a45715c86 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.818715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.965490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786ad48-2890-48fe-b3f3-3b741fb1761c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:12.005997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3526-6d9a-427c-ad86-2a2a45715c86 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:12.009327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373cc0a-dd64-4d92-aa43-80faaef1f264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:12.011012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373cc0a-dd64-4d92-aa43-80faaef1f264 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.011554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373cc0a-dd64-4d92-aa43-80faaef1f264 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.012041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373cc0a-dd64-4d92-aa43-80faaef1f264 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.013876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373cc0a-dd64-4d92-aa43-80faaef1f264 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:12.015611 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373cc0a-dd64-4d92-aa43-80faaef1f264 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:12.018661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 76/136] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:11 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:12.020234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29a2e-b679-49a3-bdc4-4bcbf3347cfa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.020762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29a2e-b679-49a3-bdc4-4bcbf3347cfa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.021255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29a2e-b679-49a3-bdc4-4bcbf3347cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.044459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c7a29a2e-b679-49a3-bdc4-4bcbf3347cfa None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:12.046100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c7a29a2e-b679-49a3-bdc4-4bcbf3347cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:12.082816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c224529-90ca-4c67-87e8-d35c9f2d70cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:12.083871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224529-90ca-4c67-87e8-d35c9f2d70cc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.084436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224529-90ca-4c67-87e8-d35c9f2d70cc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.085070 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c224529-90ca-4c67-87e8-d35c9f2d70cc None admin] PATH_INFO: `/v3/users/d2d8becce6b1469fa561088c062a1608` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.087277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c224529-90ca-4c67-87e8-d35c9f2d70cc None admin] RBAC: Authorizing `identity:get_user(user_id=d2d8becce6b1469fa561088c062a1608)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:12.090859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c224529-90ca-4c67-87e8-d35c9f2d70cc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:12.094292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 61/137] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:11 2022] GET /identity/v3/users/d2d8becce6b1469fa561088c062a1608 => generated 247 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:12.095822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c224529-90ca-4c67-87e8-d35c9f2d70cc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:12.165586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:12.175464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 77/138] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:12.176398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29a2e-b679-49a3-bdc4-4bcbf3347cfa None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:12.288393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:12.303926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29a2e-b679-49a3-bdc4-4bcbf3347cfa None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:12.312663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c224529-90ca-4c67-87e8-d35c9f2d70cc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:12.344880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f62f0d-43b3-421d-9d34-d0fe06c01f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:12.345879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f62f0d-43b3-421d-9d34-d0fe06c01f2c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.346417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f62f0d-43b3-421d-9d34-d0fe06c01f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.346896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f62f0d-43b3-421d-9d34-d0fe06c01f2c None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.348331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f62f0d-43b3-421d-9d34-d0fe06c01f2c None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:12.350014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f62f0d-43b3-421d-9d34-d0fe06c01f2c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:12.351982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 78/139] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:12 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:12.353011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f62f0d-43b3-421d-9d34-d0fe06c01f2c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:12.381753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66249404-3c81-46a2-a6f0-64b58697703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:12.383484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249404-3c81-46a2-a6f0-64b58697703b None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.384278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249404-3c81-46a2-a6f0-64b58697703b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.385036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249404-3c81-46a2-a6f0-64b58697703b None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de/users/0036e4fc61fc440984148b32ad39f535/roles/664110d895074b5a89855c373f794807` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.389381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66249404-3c81-46a2-a6f0-64b58697703b None admin] RBAC: Authorizing `identity:create_grant(project_id=eac39512f21849eda95175d1d3af66de, user_id=0036e4fc61fc440984148b32ad39f535, role_id=664110d895074b5a89855c373f794807)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:12.392622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66249404-3c81-46a2-a6f0-64b58697703b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:12.425974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 62/140] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:12 2022] PUT /identity/v3/projects/eac39512f21849eda95175d1d3af66de/users/0036e4fc61fc440984148b32ad39f535/roles/664110d895074b5a89855c373f794807 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:12.428680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66249404-3c81-46a2-a6f0-64b58697703b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:12.565756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:12.711582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66249404-3c81-46a2-a6f0-64b58697703b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:12.714768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f62f0d-43b3-421d-9d34-d0fe06c01f2c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:12.786520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01b52-b891-432b-af45-d5a1470ac496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:12.787651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01b52-b891-432b-af45-d5a1470ac496 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.790301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01b52-b891-432b-af45-d5a1470ac496 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.790301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01b52-b891-432b-af45-d5a1470ac496 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de/users/d2d8becce6b1469fa561088c062a1608/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.794419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e01b52-b891-432b-af45-d5a1470ac496 None admin] RBAC: Authorizing `identity:create_grant(project_id=eac39512f21849eda95175d1d3af66de, user_id=d2d8becce6b1469fa561088c062a1608, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:12.802289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e01b52-b891-432b-af45-d5a1470ac496 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:12.832995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 63/141] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:12 2022] PUT /identity/v3/projects/eac39512f21849eda95175d1d3af66de/users/d2d8becce6b1469fa561088c062a1608/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:12.834334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01b52-b891-432b-af45-d5a1470ac496 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:12.837317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5448c-78ea-4711-9130-00245b213c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:12.839269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5448c-78ea-4711-9130-00245b213c10 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.841977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5448c-78ea-4711-9130-00245b213c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.841977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5448c-78ea-4711-9130-00245b213c10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.852143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5448c-78ea-4711-9130-00245b213c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:12.852143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5448c-78ea-4711-9130-00245b213c10 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:12.852143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 79/142] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:12.860690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:12.862748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5448c-78ea-4711-9130-00245b213c10 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.054228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01b52-b891-432b-af45-d5a1470ac496 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.111530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5448c-78ea-4711-9130-00245b213c10 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.123619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc704c-574d-49e7-a15f-f5f87cd2fdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.124639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc704c-574d-49e7-a15f-f5f87cd2fdbe None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.125051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc704c-574d-49e7-a15f-f5f87cd2fdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.125460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc704c-574d-49e7-a15f-f5f87cd2fdbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.148766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc704c-574d-49e7-a15f-f5f87cd2fdbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-aebc704c-574d-49e7-a15f-f5f87cd2fdbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:13.159694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:13.161726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:13.163639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 64/143] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:13.170585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc704c-574d-49e7-a15f-f5f87cd2fdbe None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.192998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba087-39aa-4a58-b148-b7b90566ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.193906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba087-39aa-4a58-b148-b7b90566ee5b None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.194422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba087-39aa-4a58-b148-b7b90566ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.194852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba087-39aa-4a58-b148-b7b90566ee5b None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.196272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba087-39aa-4a58-b148-b7b90566ee5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:13.201532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba087-39aa-4a58-b148-b7b90566ee5b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:13.216540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:13.261597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 80/144] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:12 2022] POST /identity/v3/users => generated 283 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:01:13.337018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:13.405932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc704c-574d-49e7-a15f-f5f87cd2fdbe None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.476961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.478054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.478603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.479793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.481034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:13.481596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:13.484480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:13.501956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 65/145] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:13.508312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba087-39aa-4a58-b148-b7b90566ee5b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.714480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba087-39aa-4a58-b148-b7b90566ee5b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.786888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd80a-e583-4aa9-8f3d-e55f928e7e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.788467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd80a-e583-4aa9-8f3d-e55f928e7e69 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.789256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd80a-e583-4aa9-8f3d-e55f928e7e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.790005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafd80a-e583-4aa9-8f3d-e55f928e7e69 None admin] PATH_INFO: `/v3/users/e4fdf0da826442a1b9a879c68d7e98a2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.793334 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafd80a-e583-4aa9-8f3d-e55f928e7e69 None admin] RBAC: Authorizing `identity:get_user(user_id=e4fdf0da826442a1b9a879c68d7e98a2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:13.796625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafd80a-e583-4aa9-8f3d-e55f928e7e69 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:13.800102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 81/146] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/users/e4fdf0da826442a1b9a879c68d7e98a2 => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:13.808546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:14.018303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0c71-f361-4359-a83e-0e7fbedfc5bf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:14.061019 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:14.068613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bda0ab-4fba-44b6-b726-4ed2e4c870c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:14.069267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bda0ab-4fba-44b6-b726-4ed2e4c870c2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.070683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bda0ab-4fba-44b6-b726-4ed2e4c870c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.071002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bda0ab-4fba-44b6-b726-4ed2e4c870c2 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.075134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bda0ab-4fba-44b6-b726-4ed2e4c870c2 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:14.076658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bda0ab-4fba-44b6-b726-4ed2e4c870c2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:14.078825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 66/147] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:14.085216 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd80a-e583-4aa9-8f3d-e55f928e7e69 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:14.223241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:14.319380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafd80a-e583-4aa9-8f3d-e55f928e7e69 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:14.396233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d751-6471-4d01-acd9-ff0d5eee07a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:14.397838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d751-6471-4d01-acd9-ff0d5eee07a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.398624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d751-6471-4d01-acd9-ff0d5eee07a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.399368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d751-6471-4d01-acd9-ff0d5eee07a6 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de/users/e4fdf0da826442a1b9a879c68d7e98a2/roles/17ed2a44e14a4da180fe4f88ed7568b3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.408409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31d751-6471-4d01-acd9-ff0d5eee07a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=eac39512f21849eda95175d1d3af66de, user_id=e4fdf0da826442a1b9a879c68d7e98a2, role_id=17ed2a44e14a4da180fe4f88ed7568b3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:14.411910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31d751-6471-4d01-acd9-ff0d5eee07a6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:14.454743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 82/148] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:14 2022] PUT /identity/v3/projects/eac39512f21849eda95175d1d3af66de/users/e4fdf0da826442a1b9a879c68d7e98a2/roles/17ed2a44e14a4da180fe4f88ed7568b3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:14.893544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01c5c5-206e-48ec-b74d-462fe368c190 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.894343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01c5c5-206e-48ec-b74d-462fe368c190 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.894343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01c5c5-206e-48ec-b74d-462fe368c190 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.895642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 67/149] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:14.903514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5a55-1fa6-4c19-9104-a171740b488c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.904377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5a55-1fa6-4c19-9104-a171740b488c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.905093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5a55-1fa6-4c19-9104-a171740b488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.948945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3ecb5a55-1fa6-4c19-9104-a171740b488c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:14.951954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3ecb5a55-1fa6-4c19-9104-a171740b488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:15.111034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 83/150] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:15.138545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042b88b-8476-428c-a175-e583af58255d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:15.139489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042b88b-8476-428c-a175-e583af58255d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:15.140263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042b88b-8476-428c-a175-e583af58255d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:15.143296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 68/151] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:15.151843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db753-f161-4ecd-a8a4-86857d76f887 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:15.152760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db753-f161-4ecd-a8a4-86857d76f887 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:15.153509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db753-f161-4ecd-a8a4-86857d76f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:15.195626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ce7db753-f161-4ecd-a8a4-86857d76f887 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:15.198655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ce7db753-f161-4ecd-a8a4-86857d76f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:15.302282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:15.362561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 84/152] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:15.571787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042b88b-8476-428c-a175-e583af58255d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:15.815927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042b88b-8476-428c-a175-e583af58255d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:15.894604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470dcb-b6e6-44a6-8a15-c6d197a025a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:15.896952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470dcb-b6e6-44a6-8a15-c6d197a025a7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:15.897715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470dcb-b6e6-44a6-8a15-c6d197a025a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:15.898497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470dcb-b6e6-44a6-8a15-c6d197a025a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:15.924264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7470dcb-b6e6-44a6-8a15-c6d197a025a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-e7470dcb-b6e6-44a6-8a15-c6d197a025a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:15.936517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:15.938199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:15.939667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:15.943985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 69/153] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:15.951724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7db753-f161-4ecd-a8a4-86857d76f887 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.153913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7db753-f161-4ecd-a8a4-86857d76f887 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:16.225853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:16.227372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:16.228252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:16.229035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:16.230552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:16.231395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:16.234314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:16.252767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 85/154] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:16.258985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470dcb-b6e6-44a6-8a15-c6d197a025a7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.300283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.415887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:16.421414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:16.524136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470dcb-b6e6-44a6-8a15-c6d197a025a7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:16.593840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a37e-b23f-4fac-821c-2d23cf26e64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:16.594538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a37e-b23f-4fac-821c-2d23cf26e64d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:16.594814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a37e-b23f-4fac-821c-2d23cf26e64d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:16.595093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a37e-b23f-4fac-821c-2d23cf26e64d None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:16.596295 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69a37e-b23f-4fac-821c-2d23cf26e64d None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:16.597788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69a37e-b23f-4fac-821c-2d23cf26e64d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:16.599472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 70/155] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:16.605969 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a37e-b23f-4fac-821c-2d23cf26e64d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.637473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ce967-124f-4ae2-bb25-c8cb00c74c4e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:16.761724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f9a7-f29c-4d4d-bb44-4a58dd63885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:16.762704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f9a7-f29c-4d4d-bb44-4a58dd63885b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:16.763188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f9a7-f29c-4d4d-bb44-4a58dd63885b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:16.763744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f9a7-f29c-4d4d-bb44-4a58dd63885b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:16.768078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a37e-b23f-4fac-821c-2d23cf26e64d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:16.803913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382f9a7-f29c-4d4d-bb44-4a58dd63885b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:16.810830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6382f9a7-f29c-4d4d-bb44-4a58dd63885b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:16.820467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:16.822510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:16.825882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 86/156] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 524 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:16.828416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2d7b2-49d4-4016-896b-a2ce9f8ab7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:16.828416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2d7b2-49d4-4016-896b-a2ce9f8ab7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:16.828416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2d7b2-49d4-4016-896b-a2ce9f8ab7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:16.828416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2d7b2-49d4-4016-896b-a2ce9f8ab7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:16.836006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f9a7-f29c-4d4d-bb44-4a58dd63885b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.949425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2d7b2-49d4-4016-896b-a2ce9f8ab7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:16.950970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2d7b2-49d4-4016-896b-a2ce9f8ab7f4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.067352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 71/157] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:17.073756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2d7b2-49d4-4016-896b-a2ce9f8ab7f4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:17.103853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:17.189244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2d7b2-49d4-4016-896b-a2ce9f8ab7f4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:17.208210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:17.218085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f9a7-f29c-4d4d-bb44-4a58dd63885b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:17.231758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a2de2-8ae3-4f78-bd47-ccfa6b68abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:17.232422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2de2-8ae3-4f78-bd47-ccfa6b68abf3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.232705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2de2-8ae3-4f78-bd47-ccfa6b68abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.232986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2de2-8ae3-4f78-bd47-ccfa6b68abf3 None admin] PATH_INFO: `/v3/projects/e9fd56c023714538aa129531f987fced` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.234189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a2de2-8ae3-4f78-bd47-ccfa6b68abf3 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fd56c023714538aa129531f987fced)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:17.240098 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a2de2-8ae3-4f78-bd47-ccfa6b68abf3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.242327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 72/158] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:17 2022] GET /identity/v3/projects/e9fd56c023714538aa129531f987fced => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:17.248829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a2de2-8ae3-4f78-bd47-ccfa6b68abf3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:17.344013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309a40e-76ab-4607-b6b5-7c3d619b186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:17.345633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309a40e-76ab-4607-b6b5-7c3d619b186c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.346481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309a40e-76ab-4607-b6b5-7c3d619b186c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.347259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309a40e-76ab-4607-b6b5-7c3d619b186c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.348812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309a40e-76ab-4607-b6b5-7c3d619b186c None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:17.349653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309a40e-76ab-4607-b6b5-7c3d619b186c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:17.352622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309a40e-76ab-4607-b6b5-7c3d619b186c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.364962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:17.383695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a2de2-8ae3-4f78-bd47-ccfa6b68abf3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:17.398212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 87/159] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:17.399106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002df13-3af0-43af-8b4e-4ad4bbf34e6a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.399598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002df13-3af0-43af-8b4e-4ad4bbf34e6a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.400066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002df13-3af0-43af-8b4e-4ad4bbf34e6a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.406865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 88/160] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:17.412682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002df13-3af0-43af-8b4e-4ad4bbf34e6a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:17.488141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4aa79a-f5d4-496f-bfc8-5e37f5c487a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:17.489160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa79a-f5d4-496f-bfc8-5e37f5c487a9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.489658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa79a-f5d4-496f-bfc8-5e37f5c487a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.490124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa79a-f5d4-496f-bfc8-5e37f5c487a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.491089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4aa79a-f5d4-496f-bfc8-5e37f5c487a9 None admin] RBAC: Adding query filter params (role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=e9fd56c023714538aa129531f987fced, user.id=0036e4fc61fc440984148b32ad39f535) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:17.491606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4aa79a-f5d4-496f-bfc8-5e37f5c487a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:17.493847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4aa79a-f5d4-496f-bfc8-5e37f5c487a9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.506582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 73/161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:17 2022] GET /identity/v3/role_assignments?user.id=0036e4fc61fc440984148b32ad39f535&scope.project.id=e9fd56c023714538aa129531f987fced&role.id=af32346e85724870afa2c6aee5b285ed => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:17.508770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2232-5dd4-47b1-9ca3-d15c934fecc4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.509437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2232-5dd4-47b1-9ca3-d15c934fecc4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.509932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2232-5dd4-47b1-9ca3-d15c934fecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.543126 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3c8a2232-5dd4-47b1-9ca3-d15c934fecc4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:17.544939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3c8a2232-5dd4-47b1-9ca3-d15c934fecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:17.678695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 74/162] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:17.800318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002df13-3af0-43af-8b4e-4ad4bbf34e6a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:17.882861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30f89f-8515-4124-a1df-28d5013f77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:17.883971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30f89f-8515-4124-a1df-28d5013f77b5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.884556 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30f89f-8515-4124-a1df-28d5013f77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.885037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30f89f-8515-4124-a1df-28d5013f77b5 None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.889302 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30f89f-8515-4124-a1df-28d5013f77b5 None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:17.892185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30f89f-8515-4124-a1df-28d5013f77b5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.895392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 89/163] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:17 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:17.904749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a2232-5dd4-47b1-9ca3-d15c934fecc4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:18.013310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b7a81-a5d4-47ae-82f2-d177973866e7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.013722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b7a81-a5d4-47ae-82f2-d177973866e7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.014205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b7a81-a5d4-47ae-82f2-d177973866e7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.016870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 90/164] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:18.033203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45ba5-600f-4698-af18-322713f42fc3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.033684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45ba5-600f-4698-af18-322713f42fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.034182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45ba5-600f-4698-af18-322713f42fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.049704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:18.068791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a2232-5dd4-47b1-9ca3-d15c934fecc4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:18.100189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c9f45ba5-600f-4698-af18-322713f42fc3 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:18.102214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c9f45ba5-600f-4698-af18-322713f42fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:18.146618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1140-a354-4cea-87f2-0710f131d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:18.148172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1140-a354-4cea-87f2-0710f131d966 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.148970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1140-a354-4cea-87f2-0710f131d966 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.149705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1140-a354-4cea-87f2-0710f131d966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.169136 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:18.315076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 91/165] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:18.329685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1140-a354-4cea-87f2-0710f131d966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:18.332654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1140-a354-4cea-87f2-0710f131d966 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:18.392854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45ba5-600f-4698-af18-322713f42fc3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:18.555488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:18.580986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 75/166] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:18.583471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8cc8-655e-4721-9381-b451dc6c018d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.584184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8cc8-655e-4721-9381-b451dc6c018d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.584765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8cc8-655e-4721-9381-b451dc6c018d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.587550 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 76/167] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:18.589986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8cc8-655e-4721-9381-b451dc6c018d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:18.613171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45ba5-600f-4698-af18-322713f42fc3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:18.672591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7f025-3eb0-487c-a78f-de0a6b77c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:18.673703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7f025-3eb0-487c-a78f-de0a6b77c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.674301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7f025-3eb0-487c-a78f-de0a6b77c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.674812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7f025-3eb0-487c-a78f-de0a6b77c1e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.725324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7f025-3eb0-487c-a78f-de0a6b77c1e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9cc7f025-3eb0-487c-a78f-de0a6b77c1e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:18.739756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:18.740883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:18.741670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:18.743174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 92/168] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:18.753426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234107cf-4bd9-493b-a29e-34c3e6936523 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.753891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234107cf-4bd9-493b-a29e-34c3e6936523 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.754277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234107cf-4bd9-493b-a29e-34c3e6936523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.797668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-234107cf-4bd9-493b-a29e-34c3e6936523 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:18.799388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-234107cf-4bd9-493b-a29e-34c3e6936523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:18.823689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:18.839196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8cc8-655e-4721-9381-b451dc6c018d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:18.939893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ee891-a475-4e31-a2a7-0271af9bcd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:18.941529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ee891-a475-4e31-a2a7-0271af9bcd82 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.942524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ee891-a475-4e31-a2a7-0271af9bcd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.943327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ee891-a475-4e31-a2a7-0271af9bcd82 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.945881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ee891-a475-4e31-a2a7-0271af9bcd82 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:18.949370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ee891-a475-4e31-a2a7-0271af9bcd82 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:18.953225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 77/169] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:18 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:18.957214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ee891-a475-4e31-a2a7-0271af9bcd82 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:18.995262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 93/170] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:18.997337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234107cf-4bd9-493b-a29e-34c3e6936523 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.113625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:19.233633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ee891-a475-4e31-a2a7-0271af9bcd82 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.261220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234107cf-4bd9-493b-a29e-34c3e6936523 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.303211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46011-5f47-44d3-8de8-716b4bc409e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.303863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46011-5f47-44d3-8de8-716b4bc409e8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.304137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46011-5f47-44d3-8de8-716b4bc409e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.304412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46011-5f47-44d3-8de8-716b4bc409e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.321724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.322370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.322652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.326755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.327485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:19.327791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:19.329195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:19.331477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c46011-5f47-44d3-8de8-716b4bc409e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a4c46011-5f47-44d3-8de8-716b4bc409e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:19.336801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:19.339046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:19.340724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 94/171] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:19.341921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46011-5f47-44d3-8de8-716b4bc409e8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.351292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 78/172] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:19.351927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.375678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:19.496392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46011-5f47-44d3-8de8-716b4bc409e8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.536657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.537509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.537950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.538383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.539646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] RBAC: Adding query filter params (role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=eac39512f21849eda95175d1d3af66de, user.id=0036e4fc61fc440984148b32ad39f535) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:19.540092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:19.541814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:19.550248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 95/173] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/role_assignments?user.id=0036e4fc61fc440984148b32ad39f535&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=af32346e85724870afa2c6aee5b285ed => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:19.551339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.623392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9ebfd-97a2-4df6-97fe-316e20e02114 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.648629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:19.662465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:19.670960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4f2b7-2d0f-468b-a373-c6fb145442db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.671743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4f2b7-2d0f-468b-a373-c6fb145442db None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.672129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4f2b7-2d0f-468b-a373-c6fb145442db None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.672508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4f2b7-2d0f-468b-a373-c6fb145442db None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.673431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4f2b7-2d0f-468b-a373-c6fb145442db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:19.673868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4f2b7-2d0f-468b-a373-c6fb145442db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:19.675787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4f2b7-2d0f-468b-a373-c6fb145442db None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:19.687293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 79/174] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:19.689003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5212-e4ab-41a5-a5c2-cda6438b4646 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.689375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5212-e4ab-41a5-a5c2-cda6438b4646 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.689750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5212-e4ab-41a5-a5c2-cda6438b4646 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.691527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 80/175] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:19.693176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aebd28-a634-423a-82fa-d88b8060f745 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.693438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aebd28-a634-423a-82fa-d88b8060f745 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.693808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aebd28-a634-423a-82fa-d88b8060f745 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.695258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 81/176] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:19.696893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced173-439d-46bd-8dff-ffd8584ddf3a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.697728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced173-439d-46bd-8dff-ffd8584ddf3a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.697728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced173-439d-46bd-8dff-ffd8584ddf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.700930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16201be-bbe8-413e-96ad-4e265d1ee4d9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.739079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8bced173-439d-46bd-8dff-ffd8584ddf3a None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:19.740339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8bced173-439d-46bd-8dff-ffd8584ddf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:19.755428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a570c0a-79a0-45b0-a375-23ecc26ac824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.756394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570c0a-79a0-45b0-a375-23ecc26ac824 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.756834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570c0a-79a0-45b0-a375-23ecc26ac824 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.757256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570c0a-79a0-45b0-a375-23ecc26ac824 None admin] PATH_INFO: `/v3/users/0036e4fc61fc440984148b32ad39f535` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.759163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570c0a-79a0-45b0-a375-23ecc26ac824 None admin] RBAC: Authorizing `identity:get_user(user_id=0036e4fc61fc440984148b32ad39f535)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:19.761135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570c0a-79a0-45b0-a375-23ecc26ac824 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:19.763089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 96/177] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/users/0036e4fc61fc440984148b32ad39f535 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:19.764607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178bc83-fc8f-466c-9aff-1e8427336708 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.765036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178bc83-fc8f-466c-9aff-1e8427336708 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.765449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178bc83-fc8f-466c-9aff-1e8427336708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.786824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8178bc83-fc8f-466c-9aff-1e8427336708 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:19.788370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8178bc83-fc8f-466c-9aff-1e8427336708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:19.862904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 82/178] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 08:01:19.864000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bced173-439d-46bd-8dff-ffd8584ddf3a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.905814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 97/179] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:19.908249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178bc83-fc8f-466c-9aff-1e8427336708 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.998344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.050046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178bc83-fc8f-466c-9aff-1e8427336708 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.074170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bced173-439d-46bd-8dff-ffd8584ddf3a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.097050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.116019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0547d1-7a01-459a-908d-9bfbe7fad15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.117531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0547d1-7a01-459a-908d-9bfbe7fad15c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.118139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0547d1-7a01-459a-908d-9bfbe7fad15c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.118753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0547d1-7a01-459a-908d-9bfbe7fad15c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.139320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0547d1-7a01-459a-908d-9bfbe7fad15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ed0547d1-7a01-459a-908d-9bfbe7fad15c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:20.149568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:20.152005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:20.153645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:20.155772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855225d6-e3d3-4a52-9d00-f3779c1c8f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.156620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 98/180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:20.158033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855225d6-e3d3-4a52-9d00-f3779c1c8f20 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.158338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0547d1-7a01-459a-908d-9bfbe7fad15c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.158961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855225d6-e3d3-4a52-9d00-f3779c1c8f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.159748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855225d6-e3d3-4a52-9d00-f3779c1c8f20 None admin] PATH_INFO: `/v3/users/d2d8becce6b1469fa561088c062a1608` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.162093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855225d6-e3d3-4a52-9d00-f3779c1c8f20 None admin] RBAC: Authorizing `identity:get_user(user_id=d2d8becce6b1469fa561088c062a1608)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:20.165968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855225d6-e3d3-4a52-9d00-f3779c1c8f20 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:20.169950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 83/181] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/users/d2d8becce6b1469fa561088c062a1608 => generated 247 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:20.172947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f4b8-0aab-4ab6-8b5a-6eb2478d73d6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.173724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f4b8-0aab-4ab6-8b5a-6eb2478d73d6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.174436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f4b8-0aab-4ab6-8b5a-6eb2478d73d6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.177249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 84/182] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:20.178964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f4b8-0aab-4ab6-8b5a-6eb2478d73d6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.368764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0547d1-7a01-459a-908d-9bfbe7fad15c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.414735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f4b8-0aab-4ab6-8b5a-6eb2478d73d6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.418504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.424154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b4a6e-ad27-413e-816a-bb9218d20861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.424779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4a6e-ad27-413e-816a-bb9218d20861 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.425059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4a6e-ad27-413e-816a-bb9218d20861 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.425328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4a6e-ad27-413e-816a-bb9218d20861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.475509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.476304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.476663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.477059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.477838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:20.478223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:20.480423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:20.490884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 85/183] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:20.492433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.507720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b4a6e-ad27-413e-816a-bb9218d20861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:20.509311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b4a6e-ad27-413e-816a-bb9218d20861 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:20.556286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.631788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3c955-693f-480b-abb8-b39b39473c60 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.637686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 99/184] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:20.639825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075be5-cd78-40e4-b049-f85c9ccdbdd4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.640291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075be5-cd78-40e4-b049-f85c9ccdbdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.640776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075be5-cd78-40e4-b049-f85c9ccdbdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.661883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6c075be5-cd78-40e4-b049-f85c9ccdbdd4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:20.663120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6c075be5-cd78-40e4-b049-f85c9ccdbdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:20.685208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889ce6-76bb-4665-bcb1-c09f89b0deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.686153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889ce6-76bb-4665-bcb1-c09f89b0deca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.686691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889ce6-76bb-4665-bcb1-c09f89b0deca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.687188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889ce6-76bb-4665-bcb1-c09f89b0deca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.693748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.740976 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 100/185] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:20.743509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c075be5-cd78-40e4-b049-f85c9ccdbdd4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.801122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889ce6-76bb-4665-bcb1-c09f89b0deca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:20.803044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889ce6-76bb-4665-bcb1-c09f89b0deca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:20.853624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.915483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c075be5-cd78-40e4-b049-f85c9ccdbdd4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.958095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5f7b2-04c5-4316-8cea-7566e5c8edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.958919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f7b2-04c5-4316-8cea-7566e5c8edcf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.959388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f7b2-04c5-4316-8cea-7566e5c8edcf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.959783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5f7b2-04c5-4316-8cea-7566e5c8edcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.970724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 86/186] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:20.970724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889ce6-76bb-4665-bcb1-c09f89b0deca None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.975291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5f7b2-04c5-4316-8cea-7566e5c8edcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7ef5f7b2-04c5-4316-8cea-7566e5c8edcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:20.981370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:20.983371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:20.984855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:20.990128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 101/187] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:20.991114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5f7b2-04c5-4316-8cea-7566e5c8edcf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.021301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.110535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889ce6-76bb-4665-bcb1-c09f89b0deca None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.133602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5f7b2-04c5-4316-8cea-7566e5c8edcf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.148907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a05f01-49ad-43fa-bfac-f32127fb1912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.149666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05f01-49ad-43fa-bfac-f32127fb1912 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.150030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05f01-49ad-43fa-bfac-f32127fb1912 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.150433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05f01-49ad-43fa-bfac-f32127fb1912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.151852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a05f01-49ad-43fa-bfac-f32127fb1912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.153378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a05f01-49ad-43fa-bfac-f32127fb1912 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.155437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 87/188] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:21.156513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a05f01-49ad-43fa-bfac-f32127fb1912 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.171321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.187730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ccb32-27d3-4335-b4e6-84d575794530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.188374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ccb32-27d3-4335-b4e6-84d575794530 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.188651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ccb32-27d3-4335-b4e6-84d575794530 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.188922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ccb32-27d3-4335-b4e6-84d575794530 None admin] PATH_INFO: `/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.204324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ccb32-27d3-4335-b4e6-84d575794530 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a74123f5b4e55afb7e5fe5e417f7a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.205800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ccb32-27d3-4335-b4e6-84d575794530 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.214721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 102/189] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:21.214721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ccb32-27d3-4335-b4e6-84d575794530 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.284718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a05f01-49ad-43fa-bfac-f32127fb1912 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.309047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.329398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ab25-41b3-40fd-9edc-ff7af0cc0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.330038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ab25-41b3-40fd-9edc-ff7af0cc0470 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.330352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ab25-41b3-40fd-9edc-ff7af0cc0470 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.330626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ab25-41b3-40fd-9edc-ff7af0cc0470 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.331925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804ab25-41b3-40fd-9edc-ff7af0cc0470 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.333676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804ab25-41b3-40fd-9edc-ff7af0cc0470 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.335774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 88/190] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:21.341409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ab25-41b3-40fd-9edc-ff7af0cc0470 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.344163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ccb32-27d3-4335-b4e6-84d575794530 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.390953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aba30-95a5-4048-b72b-4a7dc2d4558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.391724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aba30-95a5-4048-b72b-4a7dc2d4558d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.392061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aba30-95a5-4048-b72b-4a7dc2d4558d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.392430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aba30-95a5-4048-b72b-4a7dc2d4558d None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.393936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aba30-95a5-4048-b72b-4a7dc2d4558d None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.395747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aba30-95a5-4048-b72b-4a7dc2d4558d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.397715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 103/191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:21.398797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aba30-95a5-4048-b72b-4a7dc2d4558d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.445802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.482213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ab25-41b3-40fd-9edc-ff7af0cc0470 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.534629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.535575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.536035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.536480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.537578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:21.537981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.540196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.551834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 89/192] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:21.552848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.558195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aba30-95a5-4048-b72b-4a7dc2d4558d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.596380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b287e-48ff-4b2c-9451-802dce286b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.597041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b287e-48ff-4b2c-9451-802dce286b9a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.597318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b287e-48ff-4b2c-9451-802dce286b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.597594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b287e-48ff-4b2c-9451-802dce286b9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.610654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b287e-48ff-4b2c-9451-802dce286b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3c0b287e-48ff-4b2c-9451-802dce286b9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:21.616369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:21.618388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 104/193] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:21.620701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b287e-48ff-4b2c-9451-802dce286b9a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.641403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.692128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99dca-8f49-4083-9e4b-901ac31d5390 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.739893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf02444-5db8-4f08-9edf-94f3384be6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.740770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf02444-5db8-4f08-9edf-94f3384be6ba None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.741215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf02444-5db8-4f08-9edf-94f3384be6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.741614 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf02444-5db8-4f08-9edf-94f3384be6ba None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.742700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf02444-5db8-4f08-9edf-94f3384be6ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.744369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf02444-5db8-4f08-9edf-94f3384be6ba None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.762656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.771673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b287e-48ff-4b2c-9451-802dce286b9a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.780362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 90/194] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:21 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:21.781388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf02444-5db8-4f08-9edf-94f3384be6ba None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.830823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bc310-5520-447d-9a50-2891fa202073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.831843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc310-5520-447d-9a50-2891fa202073 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.832278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc310-5520-447d-9a50-2891fa202073 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.832698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc310-5520-447d-9a50-2891fa202073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.942858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf02444-5db8-4f08-9edf-94f3384be6ba None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.963614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bc310-5520-447d-9a50-2891fa202073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.966152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bc310-5520-447d-9a50-2891fa202073 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.985725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.994013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.995455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.995847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.996365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.997262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] RBAC: Adding query filter params (role.id=664110d895074b5a89855c373f794807, scope.project.id=eac39512f21849eda95175d1d3af66de, user.id=0036e4fc61fc440984148b32ad39f535) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:21.997707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.999658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:22.007796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 91/195] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/role_assignments?user.id=0036e4fc61fc440984148b32ad39f535&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=664110d895074b5a89855c373f794807 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:22.018020 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:22.141311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:22.176743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 105/196] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:22.178428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bc310-5520-447d-9a50-2891fa202073 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:22.235869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786726d-48f0-468f-89d1-7fe2d91b9f9d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:22.316389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:22.318465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.319231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.319878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.321814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=eac39512f21849eda95175d1d3af66de, user.id=d2d8becce6b1469fa561088c062a1608) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:22.322579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:22.326968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:22.343922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 92/197] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/role_assignments?user.id=d2d8becce6b1469fa561088c062a1608&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=b76f0bbd02794923b10af161becac1c6 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:22.345637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:22.413019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bc310-5520-447d-9a50-2891fa202073 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:22.446902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:22.498306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c383a9-31af-4bbb-a473-6586f0cd207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:22.499321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c383a9-31af-4bbb-a473-6586f0cd207b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.499914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c383a9-31af-4bbb-a473-6586f0cd207b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.500371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c383a9-31af-4bbb-a473-6586f0cd207b None admin] PATH_INFO: `/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.502660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c383a9-31af-4bbb-a473-6586f0cd207b None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a74123f5b4e55afb7e5fe5e417f7a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:22.505332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c383a9-31af-4bbb-a473-6586f0cd207b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:22.508389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 106/198] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a => generated 283 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:22.509856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c383a9-31af-4bbb-a473-6586f0cd207b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:22.602797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b003-f48e-4c6d-99d2-a56410b2e92c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:22.651626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:22.683133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:22.684194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.684681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.685177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.686524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:22.687055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:22.689800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:22.708808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c383a9-31af-4bbb-a473-6586f0cd207b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:22.710691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 93/199] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:22.712324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:22.751901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d57f0-244a-4660-a0fc-d94bbfec3d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:22.752552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d57f0-244a-4660-a0fc-d94bbfec3d2a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.752831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d57f0-244a-4660-a0fc-d94bbfec3d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.753111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d57f0-244a-4660-a0fc-d94bbfec3d2a None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.754346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d57f0-244a-4660-a0fc-d94bbfec3d2a None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:22.755819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d57f0-244a-4660-a0fc-d94bbfec3d2a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:22.757484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 107/200] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:22.758287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d57f0-244a-4660-a0fc-d94bbfec3d2a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:22.811314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:22.873526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d57f0-244a-4660-a0fc-d94bbfec3d2a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:22.912403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e2a2e-04cf-4dc4-8e72-9a12335e06c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:22.913051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2a2e-04cf-4dc4-8e72-9a12335e06c1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.913332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2a2e-04cf-4dc4-8e72-9a12335e06c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.913615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2a2e-04cf-4dc4-8e72-9a12335e06c1 None admin] PATH_INFO: `/v3/users/e4fdf0da826442a1b9a879c68d7e98a2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.914853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e2a2e-04cf-4dc4-8e72-9a12335e06c1 None admin] RBAC: Authorizing `identity:get_user(user_id=e4fdf0da826442a1b9a879c68d7e98a2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:22.916318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e2a2e-04cf-4dc4-8e72-9a12335e06c1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:22.918170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 108/201] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/users/e4fdf0da826442a1b9a879c68d7e98a2 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:22.919017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e2a2e-04cf-4dc4-8e72-9a12335e06c1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:22.929709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850983-305c-4e32-9be3-ceeb8c2a2fde None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.003480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8900d-320a-4e49-9aaf-66e8875919df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.004505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8900d-320a-4e49-9aaf-66e8875919df None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.004983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8900d-320a-4e49-9aaf-66e8875919df None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.005475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8900d-320a-4e49-9aaf-66e8875919df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.049076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e2a2e-04cf-4dc4-8e72-9a12335e06c1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.080049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.087308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.120921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8900d-320a-4e49-9aaf-66e8875919df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.123608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.124216 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.124395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8900d-320a-4e49-9aaf-66e8875919df None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.124556 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.124757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.125493 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6, user.id=aa7a74123f5b4e55afb7e5fe5e417f7a) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:23.125804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.127318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.135394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 109/202] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/role_assignments?user.id=aa7a74123f5b4e55afb7e5fe5e417f7a&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=b76f0bbd02794923b10af161becac1c6 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:23.136694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.352432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 94/203] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:23.363165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8900d-320a-4e49-9aaf-66e8875919df None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.398135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ae8de-4a19-42c2-914d-02dc92f02641 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.460774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db66e68-54e4-45b1-a73d-01de3e4c7af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.461769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db66e68-54e4-45b1-a73d-01de3e4c7af0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.462251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db66e68-54e4-45b1-a73d-01de3e4c7af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.462777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db66e68-54e4-45b1-a73d-01de3e4c7af0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.569573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.582027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.624838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db66e68-54e4-45b1-a73d-01de3e4c7af0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.628240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db66e68-54e4-45b1-a73d-01de3e4c7af0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.653231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8900d-320a-4e49-9aaf-66e8875919df None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.748570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118090-0aa9-40f6-84eb-f82252d481f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.749206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118090-0aa9-40f6-84eb-f82252d481f5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.749490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118090-0aa9-40f6-84eb-f82252d481f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.749763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118090-0aa9-40f6-84eb-f82252d481f5 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.755274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16118090-0aa9-40f6-84eb-f82252d481f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.756814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16118090-0aa9-40f6-84eb-f82252d481f5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.762837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 95/204] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:23.786340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118090-0aa9-40f6-84eb-f82252d481f5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.923308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118090-0aa9-40f6-84eb-f82252d481f5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.944013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 110/205] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:23.958941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db66e68-54e4-45b1-a73d-01de3e4c7af0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.985753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.987319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.988094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.988852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.990628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] RBAC: Adding query filter params (role.id=664110d895074b5a89855c373f794807, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6, user.id=aa7a74123f5b4e55afb7e5fe5e417f7a) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:23.991503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:24.003019 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:24.021708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 96/206] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/role_assignments?user.id=aa7a74123f5b4e55afb7e5fe5e417f7a&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=664110d895074b5a89855c373f794807 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:24.159771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:24.224941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db66e68-54e4-45b1-a73d-01de3e4c7af0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:24.307700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74017a5f-d3ef-418f-833a-f18a6ba0198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:24.308737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017a5f-d3ef-418f-833a-f18a6ba0198e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:24.309200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017a5f-d3ef-418f-833a-f18a6ba0198e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:24.309655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74017a5f-d3ef-418f-833a-f18a6ba0198e None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:24.314810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74017a5f-d3ef-418f-833a-f18a6ba0198e None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:24.317417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74017a5f-d3ef-418f-833a-f18a6ba0198e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:24.320725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 111/207] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:24.329879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:24.368409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:24.553457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4cdf3-a18f-4119-97eb-bb814041d903 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:24.607057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c451d-a673-446e-b42b-ecc3f5d8fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:24.607697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c451d-a673-446e-b42b-ecc3f5d8fb5f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:24.607986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c451d-a673-446e-b42b-ecc3f5d8fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:24.608267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c451d-a673-446e-b42b-ecc3f5d8fb5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:24.609018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c451d-a673-446e-b42b-ecc3f5d8fb5f None admin] RBAC: Adding query filter params (role.id=17ed2a44e14a4da180fe4f88ed7568b3, scope.project.id=eac39512f21849eda95175d1d3af66de, user.id=e4fdf0da826442a1b9a879c68d7e98a2) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:24.609331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c451d-a673-446e-b42b-ecc3f5d8fb5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:24.610828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c451d-a673-446e-b42b-ecc3f5d8fb5f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:24.619282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 97/208] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:24 2022] GET /identity/v3/role_assignments?user.id=e4fdf0da826442a1b9a879c68d7e98a2&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=17ed2a44e14a4da180fe4f88ed7568b3 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:25.456541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23e82-483a-48f9-a56a-8ae3c7af27fc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:25.457394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23e82-483a-48f9-a56a-8ae3c7af27fc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:25.457600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a23e82-483a-48f9-a56a-8ae3c7af27fc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:25.459942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 112/209] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:25.471355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee07849-5fa2-4ea6-91cb-45c07b9e83e5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:25.472061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee07849-5fa2-4ea6-91cb-45c07b9e83e5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:25.472061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee07849-5fa2-4ea6-91cb-45c07b9e83e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:25.499438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2ee07849-5fa2-4ea6-91cb-45c07b9e83e5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:25.500651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2ee07849-5fa2-4ea6-91cb-45c07b9e83e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:25.507242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e1070-fd71-44f6-ad0d-f0ca85d74a9a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:25.508334 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e1070-fd71-44f6-ad0d-f0ca85d74a9a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:25.509056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e1070-fd71-44f6-ad0d-f0ca85d74a9a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:25.511664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 113/210] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:25.519689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3a149-4c61-4e5b-aec3-3e1c0c849c07 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:25.520142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3a149-4c61-4e5b-aec3-3e1c0c849c07 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:25.520564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3a149-4c61-4e5b-aec3-3e1c0c849c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:25.551182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-22f3a149-4c61-4e5b-aec3-3e1c0c849c07 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:25.553654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-22f3a149-4c61-4e5b-aec3-3e1c0c849c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:25.629206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 98/211] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:25.694423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 114/212] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:25.914553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee07849-5fa2-4ea6-91cb-45c07b9e83e5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:25.937817 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.100922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee07849-5fa2-4ea6-91cb-45c07b9e83e5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.162770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c5abf-4fc2-4bae-b3b5-4af4907b409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.163724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5abf-4fc2-4bae-b3b5-4af4907b409f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.164181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5abf-4fc2-4bae-b3b5-4af4907b409f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.164700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5abf-4fc2-4bae-b3b5-4af4907b409f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.166354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c5abf-4fc2-4bae-b3b5-4af4907b409f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:26.169556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c5abf-4fc2-4bae-b3b5-4af4907b409f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:26.172498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 99/213] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:26.178173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3a149-4c61-4e5b-aec3-3e1c0c849c07 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.215034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c5abf-4fc2-4bae-b3b5-4af4907b409f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.333524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.349043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.369089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3a149-4c61-4e5b-aec3-3e1c0c849c07 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.389272 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c5abf-4fc2-4bae-b3b5-4af4907b409f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8713d65-81ba-46be-8c29-4dcceb066b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.426812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713d65-81ba-46be-8c29-4dcceb066b05 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.427282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713d65-81ba-46be-8c29-4dcceb066b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.427999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713d65-81ba-46be-8c29-4dcceb066b05 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.429303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8713d65-81ba-46be-8c29-4dcceb066b05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:26.432317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8713d65-81ba-46be-8c29-4dcceb066b05 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:26.433808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e35688-8538-4f92-bcb3-f3ec300aa7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.434602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e35688-8538-4f92-bcb3-f3ec300aa7ff None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.434941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e35688-8538-4f92-bcb3-f3ec300aa7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.435225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e35688-8538-4f92-bcb3-f3ec300aa7ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.454085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e35688-8538-4f92-bcb3-f3ec300aa7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-80e35688-8538-4f92-bcb3-f3ec300aa7ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:26.463582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:26.465831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:26.467710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:26.471944 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 115/214] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:26 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:26.474450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f38c-2b65-49e9-a555-e538b76bfcc3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.475723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f38c-2b65-49e9-a555-e538b76bfcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.475723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f38c-2b65-49e9-a555-e538b76bfcc3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.477233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 116/215] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:26.478362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 100/216] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:26.484210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552066-0b2b-4923-8851-9b723f9d6988 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.485051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552066-0b2b-4923-8851-9b723f9d6988 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.485530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552066-0b2b-4923-8851-9b723f9d6988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.487105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e35688-8538-4f92-bcb3-f3ec300aa7ff None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.520927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7b552066-0b2b-4923-8851-9b723f9d6988 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:26.523928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7b552066-0b2b-4923-8851-9b723f9d6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:26.668793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 117/217] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:26.696516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e35688-8538-4f92-bcb3-f3ec300aa7ff None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.736419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.737025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.737591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.737870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.738648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:26.738981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:26.740398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:26.749109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.754668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 101/218] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:26.760174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552066-0b2b-4923-8851-9b723f9d6988 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.831070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.882044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552066-0b2b-4923-8851-9b723f9d6988 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.923004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25092482-b18f-4f79-a43e-6bf39a171c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.924054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25092482-b18f-4f79-a43e-6bf39a171c12 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.924564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25092482-b18f-4f79-a43e-6bf39a171c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.925065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25092482-b18f-4f79-a43e-6bf39a171c12 None admin] PATH_INFO: `/v3/users/4ee83a3a9a2e4291a7b895e383450ead` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.943459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25092482-b18f-4f79-a43e-6bf39a171c12 None admin] RBAC: Authorizing `identity:get_user(user_id=4ee83a3a9a2e4291a7b895e383450ead)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:26.945304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25092482-b18f-4f79-a43e-6bf39a171c12 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:26.947758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 118/219] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/users/4ee83a3a9a2e4291a7b895e383450ead => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:26.954308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:27.076284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc8020-33a3-479e-a15f-8a5015f13744 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:27.106706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54a86-aaa7-4db8-9107-19c52e244dbe None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.107353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54a86-aaa7-4db8-9107-19c52e244dbe None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.107829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a54a86-aaa7-4db8-9107-19c52e244dbe None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.109980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 119/220] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:27.116042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbb52-0b03-4553-8f5e-fb0da6616e36 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.116668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbb52-0b03-4553-8f5e-fb0da6616e36 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.117409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbb52-0b03-4553-8f5e-fb0da6616e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.123751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b797-7204-40e6-86bd-b3e8ad5f2984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:27.124399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b797-7204-40e6-86bd-b3e8ad5f2984 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.124685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b797-7204-40e6-86bd-b3e8ad5f2984 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.124962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b797-7204-40e6-86bd-b3e8ad5f2984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.145596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0dadbb52-0b03-4553-8f5e-fb0da6616e36 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:27.148456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0dadbb52-0b03-4553-8f5e-fb0da6616e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:27.252717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:27.258708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b797-7204-40e6-86bd-b3e8ad5f2984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:27.262681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b797-7204-40e6-86bd-b3e8ad5f2984 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:27.294473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 120/221] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:27.302330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadbb52-0b03-4553-8f5e-fb0da6616e36 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:27.395601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:27.533010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 102/222] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:27.539244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b797-7204-40e6-86bd-b3e8ad5f2984 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:27.564678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadbb52-0b03-4553-8f5e-fb0da6616e36 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:27.680103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a7d81-6c81-4d09-81f3-f638b8e3fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:27.681971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a7d81-6c81-4d09-81f3-f638b8e3fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.682937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a7d81-6c81-4d09-81f3-f638b8e3fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.683519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a7d81-6c81-4d09-81f3-f638b8e3fbd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.735904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a7d81-6c81-4d09-81f3-f638b8e3fbd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:27.752812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-497a7d81-6c81-4d09-81f3-f638b8e3fbd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:27.754591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:27.756280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:27.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:27.765375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 121/223] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:27.772075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a7d81-6c81-4d09-81f3-f638b8e3fbd6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:27.774003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b797-7204-40e6-86bd-b3e8ad5f2984 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:27.857245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6cd3-abe0-4452-9865-2466c654c792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:27.857813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6cd3-abe0-4452-9865-2466c654c792 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.858102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6cd3-abe0-4452-9865-2466c654c792 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.859104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6cd3-abe0-4452-9865-2466c654c792 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.863124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b6cd3-abe0-4452-9865-2466c654c792 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:27.864640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b6cd3-abe0-4452-9865-2466c654c792 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:27.866785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 103/224] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:27 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:27.873516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6cd3-abe0-4452-9865-2466c654c792 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.024082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a7d81-6c81-4d09-81f3-f638b8e3fbd6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.035913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:28.067572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.068603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.069091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.069683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.070699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:28.071240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:28.073428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:28.083540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 122/225] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:28.084744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.113260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6cd3-abe0-4452-9865-2466c654c792 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.183758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.184824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.185354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.185962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.187682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] RBAC: Adding query filter params (role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6, user.id=4ee83a3a9a2e4291a7b895e383450ead) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:28.188223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:28.191107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:28.203553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 104/226] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:27 2022] GET /identity/v3/role_assignments?user.id=4ee83a3a9a2e4291a7b895e383450ead&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=af32346e85724870afa2c6aee5b285ed => generated 259 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:28.205169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.205660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbd4d1-5fcd-4d67-8497-e2269f6474c2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.250746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222878e-a896-41dd-baac-b57afb549480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.251895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222878e-a896-41dd-baac-b57afb549480 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.252695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222878e-a896-41dd-baac-b57afb549480 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.253269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222878e-a896-41dd-baac-b57afb549480 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.267447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222878e-a896-41dd-baac-b57afb549480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9222878e-a896-41dd-baac-b57afb549480 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:28.273553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:28.274549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:28.275359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:28.278333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 123/227] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:28.282887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:28.285551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222878e-a896-41dd-baac-b57afb549480 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.327050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:28.424696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5615b-37b5-4f5a-930e-46a4c3843fdb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.480359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439eec0-b298-4511-9a85-9a4195736a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.481022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eec0-b298-4511-9a85-9a4195736a95 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.481301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eec0-b298-4511-9a85-9a4195736a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.481642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eec0-b298-4511-9a85-9a4195736a95 None admin] PATH_INFO: `/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.482954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439eec0-b298-4511-9a85-9a4195736a95 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a74123f5b4e55afb7e5fe5e417f7a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:28.484425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439eec0-b298-4511-9a85-9a4195736a95 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:28.486453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 105/228] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:28 2022] GET /identity/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:28.491978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439eec0-b298-4511-9a85-9a4195736a95 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.517474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222878e-a896-41dd-baac-b57afb549480 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.594709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.595668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.595668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.595896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.596547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:28.596886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:28.598306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:28.623879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 124/229] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:28.630567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.719672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:28.727325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439eec0-b298-4511-9a85-9a4195736a95 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.798848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e9ff-72a3-4ff9-9671-e0cde7bb2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.800576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e9ff-72a3-4ff9-9671-e0cde7bb2258 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.801413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e9ff-72a3-4ff9-9671-e0cde7bb2258 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.802218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e9ff-72a3-4ff9-9671-e0cde7bb2258 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.804665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00e9ff-72a3-4ff9-9671-e0cde7bb2258 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:28.808276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00e9ff-72a3-4ff9-9671-e0cde7bb2258 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:28.811558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 106/230] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:28 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:28.825151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e9ff-72a3-4ff9-9671-e0cde7bb2258 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.922813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:28.956790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e0523-5a88-4b14-8d2f-a62647ec8c06 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:29.033835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e9ff-72a3-4ff9-9671-e0cde7bb2258 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:29.067633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7657d48-1f2a-4be3-82d5-6856eb6315e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:29.068532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7657d48-1f2a-4be3-82d5-6856eb6315e6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.069028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7657d48-1f2a-4be3-82d5-6856eb6315e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.069522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7657d48-1f2a-4be3-82d5-6856eb6315e6 None admin] PATH_INFO: `/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.079722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7657d48-1f2a-4be3-82d5-6856eb6315e6 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a74123f5b4e55afb7e5fe5e417f7a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:29.082555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7657d48-1f2a-4be3-82d5-6856eb6315e6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:29.085582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 125/231] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:28 2022] GET /identity/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a => generated 283 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:29.095026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7657d48-1f2a-4be3-82d5-6856eb6315e6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:29.105256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9868-e4cc-4f25-9c08-961fb876f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:29.106998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9868-e4cc-4f25-9c08-961fb876f643 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.107758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9868-e4cc-4f25-9c08-961fb876f643 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.108513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9868-e4cc-4f25-9c08-961fb876f643 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/users/aa7a74123f5b4e55afb7e5fe5e417f7a/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.112579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9868-e4cc-4f25-9c08-961fb876f643 None admin] RBAC: Authorizing `identity:create_grant(project_id=d802ed4ff9094e3d8e405ce3457077c6, user_id=aa7a74123f5b4e55afb7e5fe5e417f7a, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:29.115683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9868-e4cc-4f25-9c08-961fb876f643 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:29.150293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 107/232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:28 2022] PUT /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/users/aa7a74123f5b4e55afb7e5fe5e417f7a/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:29.374198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7657d48-1f2a-4be3-82d5-6856eb6315e6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:29.443437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82f320-7a83-4e46-b25e-33bd5c8c6995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:29.445003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f320-7a83-4e46-b25e-33bd5c8c6995 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.445773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f320-7a83-4e46-b25e-33bd5c8c6995 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.446562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f320-7a83-4e46-b25e-33bd5c8c6995 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.449435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82f320-7a83-4e46-b25e-33bd5c8c6995 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:29.452425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82f320-7a83-4e46-b25e-33bd5c8c6995 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:29.456457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 126/233] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:29 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:29.468093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9868-e4cc-4f25-9c08-961fb876f643 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:29.514821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b985-ffe0-4514-8bf8-c11360210e3b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.515281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b985-ffe0-4514-8bf8-c11360210e3b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.515742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0b985-ffe0-4514-8bf8-c11360210e3b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.518499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 127/234] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:29.524854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d1803-7037-4699-b033-608d5273d573 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.525335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d1803-7037-4699-b033-608d5273d573 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.525809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d1803-7037-4699-b033-608d5273d573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.565036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:29.579028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-191d1803-7037-4699-b033-608d5273d573 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:29.581776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-191d1803-7037-4699-b033-608d5273d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:29.660062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:29.808765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9868-e4cc-4f25-9c08-961fb876f643 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:29.810045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 128/235] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:29.812441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36a2b-7b66-44cc-96ba-22ba3c411bf6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.812902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36a2b-7b66-44cc-96ba-22ba3c411bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.813388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36a2b-7b66-44cc-96ba-22ba3c411bf6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.816310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 129/236] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:29.825712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4580b7-994e-460a-8abe-82de897dc2a2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.826217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4580b7-994e-460a-8abe-82de897dc2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.826751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4580b7-994e-460a-8abe-82de897dc2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.860267 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5e4580b7-994e-460a-8abe-82de897dc2a2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:29.862059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5e4580b7-994e-460a-8abe-82de897dc2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:29.898375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03bdbc-36d0-4656-8220-1bdb8ce1dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:29.899539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03bdbc-36d0-4656-8220-1bdb8ce1dbfa None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.900004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03bdbc-36d0-4656-8220-1bdb8ce1dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.900485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03bdbc-36d0-4656-8220-1bdb8ce1dbfa None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/users/aa7a74123f5b4e55afb7e5fe5e417f7a/roles/664110d895074b5a89855c373f794807` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.909756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03bdbc-36d0-4656-8220-1bdb8ce1dbfa None admin] RBAC: Authorizing `identity:create_grant(project_id=d802ed4ff9094e3d8e405ce3457077c6, user_id=aa7a74123f5b4e55afb7e5fe5e417f7a, role_id=664110d895074b5a89855c373f794807)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:29.912656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03bdbc-36d0-4656-8220-1bdb8ce1dbfa None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:29.962804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 108/237] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:29 2022] PUT /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/users/aa7a74123f5b4e55afb7e5fe5e417f7a/roles/664110d895074b5a89855c373f794807 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:30.048454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 130/238] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:30.395771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03bdbc-36d0-4656-8220-1bdb8ce1dbfa None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:30.622897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:30.656398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03bdbc-36d0-4656-8220-1bdb8ce1dbfa None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:30.738170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903f05-0ff5-465a-933a-7d462fe149ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:30.739616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903f05-0ff5-465a-933a-7d462fe149ff None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:30.740117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903f05-0ff5-465a-933a-7d462fe149ff None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:30.740617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903f05-0ff5-465a-933a-7d462fe149ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:30.771914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903f05-0ff5-465a-933a-7d462fe149ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-20903f05-0ff5-465a-933a-7d462fe149ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:30.782857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:30.784523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:30.785984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 109/239] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:30.794651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4580b7-994e-460a-8abe-82de897dc2a2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:30.798121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903f05-0ff5-465a-933a-7d462fe149ff None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:30.998694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903f05-0ff5-465a-933a-7d462fe149ff None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.029991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.050513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4580b7-994e-460a-8abe-82de897dc2a2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.054369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f7c04-cd94-4f6b-976f-c5723db83b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.055061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7c04-cd94-4f6b-976f-c5723db83b6e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.055342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7c04-cd94-4f6b-976f-c5723db83b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.055610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7c04-cd94-4f6b-976f-c5723db83b6e None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.056319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f7c04-cd94-4f6b-976f-c5723db83b6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:31.056627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f7c04-cd94-4f6b-976f-c5723db83b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:31.058676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f7c04-cd94-4f6b-976f-c5723db83b6e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.068911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 110/240] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:31.069949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa99431-cf44-4fbe-96dd-ae554c6174c6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.070244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa99431-cf44-4fbe-96dd-ae554c6174c6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.070558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa99431-cf44-4fbe-96dd-ae554c6174c6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.076864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 111/241] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:31.077764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa99431-cf44-4fbe-96dd-ae554c6174c6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:31.095350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.149943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993274fd-14c0-469c-a87d-0d7534aba4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.152085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993274fd-14c0-469c-a87d-0d7534aba4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.152844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993274fd-14c0-469c-a87d-0d7534aba4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.153546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993274fd-14c0-469c-a87d-0d7534aba4b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.156647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993274fd-14c0-469c-a87d-0d7534aba4b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:31.160360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993274fd-14c0-469c-a87d-0d7534aba4b2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.164505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 131/242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:31.167714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7186e7-a263-4aaf-bab6-44a9f22e916c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.168773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7186e7-a263-4aaf-bab6-44a9f22e916c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.169552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7186e7-a263-4aaf-bab6-44a9f22e916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.206860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6a7186e7-a263-4aaf-bab6-44a9f22e916c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:31.210670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6a7186e7-a263-4aaf-bab6-44a9f22e916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:31.242145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa99431-cf44-4fbe-96dd-ae554c6174c6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.305301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec4ba4-2c1b-452e-bafd-08e0a6dd97ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.306451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec4ba4-2c1b-452e-bafd-08e0a6dd97ef None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.308221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec4ba4-2c1b-452e-bafd-08e0a6dd97ef None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.308221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec4ba4-2c1b-452e-bafd-08e0a6dd97ef None admin] PATH_INFO: `/v3/users/69ad76c8a4aa4eeb9022c4a05c71bfe7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.333101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec4ba4-2c1b-452e-bafd-08e0a6dd97ef None admin] RBAC: Authorizing `identity:get_user(user_id=69ad76c8a4aa4eeb9022c4a05c71bfe7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:31.335776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec4ba4-2c1b-452e-bafd-08e0a6dd97ef None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.339516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 112/243] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/users/69ad76c8a4aa4eeb9022c4a05c71bfe7 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:31.340779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec4ba4-2c1b-452e-bafd-08e0a6dd97ef None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:31.377295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 132/244] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:31.379357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7186e7-a263-4aaf-bab6-44a9f22e916c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:31.586953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.601407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.627578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7186e7-a263-4aaf-bab6-44a9f22e916c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.686895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec4ba4-2c1b-452e-bafd-08e0a6dd97ef None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.703482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffc27b-69f6-4d88-a225-85c937affca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.704978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffc27b-69f6-4d88-a225-85c937affca2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.705871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffc27b-69f6-4d88-a225-85c937affca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.706643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffc27b-69f6-4d88-a225-85c937affca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.751143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9809-9550-4e19-bc50-728174a54852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.751778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9809-9550-4e19-bc50-728174a54852 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.752063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9809-9550-4e19-bc50-728174a54852 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.752336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9809-9550-4e19-bc50-728174a54852 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.753008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9809-9550-4e19-bc50-728174a54852 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:31.754730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9809-9550-4e19-bc50-728174a54852 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.784491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 113/245] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:31 2022] POST /identity/v3/users => generated 293 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:31.873838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffc27b-69f6-4d88-a225-85c937affca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:31.877694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffc27b-69f6-4d88-a225-85c937affca2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.950388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9809-9550-4e19-bc50-728174a54852 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.102186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9809-9550-4e19-bc50-728174a54852 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.118737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.130930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.145320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497749c-3bb3-46ad-abb1-f5d8e68da161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.146745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497749c-3bb3-46ad-abb1-f5d8e68da161 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.147286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497749c-3bb3-46ad-abb1-f5d8e68da161 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.147798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497749c-3bb3-46ad-abb1-f5d8e68da161 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.166513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 133/246] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:32.170022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffc27b-69f6-4d88-a225-85c937affca2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.175252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497749c-3bb3-46ad-abb1-f5d8e68da161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-0497749c-3bb3-46ad-abb1-f5d8e68da161 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:32.187503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:32.188486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:32.189292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:32.189918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 114/247] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:01:32.199651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497749c-3bb3-46ad-abb1-f5d8e68da161 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.373328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffc27b-69f6-4d88-a225-85c937affca2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.451883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0131f-f043-4c7a-8f5a-22e94e0c3a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.452496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0131f-f043-4c7a-8f5a-22e94e0c3a09 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.452776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0131f-f043-4c7a-8f5a-22e94e0c3a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.453057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0131f-f043-4c7a-8f5a-22e94e0c3a09 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.455810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0131f-f043-4c7a-8f5a-22e94e0c3a09 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.457368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0131f-f043-4c7a-8f5a-22e94e0c3a09 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.459380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 134/248] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:32.471189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0131f-f043-4c7a-8f5a-22e94e0c3a09 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.478763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497749c-3bb3-46ad-abb1-f5d8e68da161 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.528938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.529966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.530507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.530989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.532028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:32.532661 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.534331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.544895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.548137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 115/249] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:32.559554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.610196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0131f-f043-4c7a-8f5a-22e94e0c3a09 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.622922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.660642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.661284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.661568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.661851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.662664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] RBAC: Adding query filter params (role.id=17ed2a44e14a4da180fe4f88ed7568b3, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6, user.id=69ad76c8a4aa4eeb9022c4a05c71bfe7) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:32.662985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.664580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.679147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 135/250] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/role_assignments?user.id=69ad76c8a4aa4eeb9022c4a05c71bfe7&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=17ed2a44e14a4da180fe4f88ed7568b3 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:32.705089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021007f6-e96f-4eef-83b1-69ecdea064eb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.753213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f87d47-8687-4a60-a045-7440054ae03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.754249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87d47-8687-4a60-a045-7440054ae03f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.754775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87d47-8687-4a60-a045-7440054ae03f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.755287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87d47-8687-4a60-a045-7440054ae03f None admin] PATH_INFO: `/v3/users/4ee83a3a9a2e4291a7b895e383450ead` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.756862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f87d47-8687-4a60-a045-7440054ae03f None admin] RBAC: Authorizing `identity:get_user(user_id=4ee83a3a9a2e4291a7b895e383450ead)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.758687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f87d47-8687-4a60-a045-7440054ae03f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.761303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 116/251] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/users/4ee83a3a9a2e4291a7b895e383450ead => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:32.770466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.915101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75970f7-bc5b-431f-8dc0-daff8a1cbac5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.917845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a22892-8ea1-49b6-ac0b-f186f80787b5 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.918420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a22892-8ea1-49b6-ac0b-f186f80787b5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.918903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a22892-8ea1-49b6-ac0b-f186f80787b5 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.920786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 117/252] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:32.928227 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1aaf9-303b-4310-98d4-d58e43244c6c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.928864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1aaf9-303b-4310-98d4-d58e43244c6c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.929342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1aaf9-303b-4310-98d4-d58e43244c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.950996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.962393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-66d1aaf9-303b-4310-98d4-d58e43244c6c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:32.962393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-66d1aaf9-303b-4310-98d4-d58e43244c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:32.982142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186cdde-6bc4-4ebd-87d5-10d4e356d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.983918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cdde-6bc4-4ebd-87d5-10d4e356d3fb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.984206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cdde-6bc4-4ebd-87d5-10d4e356d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.984486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cdde-6bc4-4ebd-87d5-10d4e356d3fb None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.986960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186cdde-6bc4-4ebd-87d5-10d4e356d3fb None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.988495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186cdde-6bc4-4ebd-87d5-10d4e356d3fb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.994319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 136/253] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:33.000047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186cdde-6bc4-4ebd-87d5-10d4e356d3fb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:33.102605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 118/254] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:33.174190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186cdde-6bc4-4ebd-87d5-10d4e356d3fb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:33.215133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a08a2-29ec-4ca3-bbd3-fe1560bb6da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:33.215997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a08a2-29ec-4ca3-bbd3-fe1560bb6da3 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.216289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a08a2-29ec-4ca3-bbd3-fe1560bb6da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.216558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a08a2-29ec-4ca3-bbd3-fe1560bb6da3 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/users/4ee83a3a9a2e4291a7b895e383450ead/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.218654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a08a2-29ec-4ca3-bbd3-fe1560bb6da3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d802ed4ff9094e3d8e405ce3457077c6, user_id=4ee83a3a9a2e4291a7b895e383450ead, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:33.220161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a08a2-29ec-4ca3-bbd3-fe1560bb6da3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:33.238856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 137/255] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:32 2022] PUT /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/users/4ee83a3a9a2e4291a7b895e383450ead/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:33.599630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622571a-6096-4092-ba66-cc34891d8634 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.600018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622571a-6096-4092-ba66-cc34891d8634 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.600254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622571a-6096-4092-ba66-cc34891d8634 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.602090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 119/256] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:33.610804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cb37-324c-4193-b4ed-535e093b30e6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.611298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cb37-324c-4193-b4ed-535e093b30e6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.611786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cb37-324c-4193-b4ed-535e093b30e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.654744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8b80cb37-324c-4193-b4ed-535e093b30e6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:33.656776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8b80cb37-324c-4193-b4ed-535e093b30e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:33.752747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:33.814746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 138/257] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:33.976437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622571a-6096-4092-ba66-cc34891d8634 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.039557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:34.121175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622571a-6096-4092-ba66-cc34891d8634 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.176377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9017045-aa9c-4dac-82e6-ece93c2a18fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.177447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9017045-aa9c-4dac-82e6-ece93c2a18fa None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.177955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9017045-aa9c-4dac-82e6-ece93c2a18fa None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.178456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9017045-aa9c-4dac-82e6-ece93c2a18fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.197087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9017045-aa9c-4dac-82e6-ece93c2a18fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-c9017045-aa9c-4dac-82e6-ece93c2a18fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:34.203268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:34.204223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:34.205015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:34.207860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 120/258] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:34.217978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80cb37-324c-4193-b4ed-535e093b30e6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.488887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80cb37-324c-4193-b4ed-535e093b30e6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.535048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.536036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.536544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.537042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.537916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:34.538452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:34.540071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:34.555501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 139/259] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:34.564101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9017045-aa9c-4dac-82e6-ece93c2a18fa None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.587932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.678937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:34.803782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cba9c-9fd1-4816-80e9-39a5d9f88f21 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.864933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6ebf8-f029-40d4-8f49-88b33b846e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.865966 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ebf8-f029-40d4-8f49-88b33b846e2e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.866475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ebf8-f029-40d4-8f49-88b33b846e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.866950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ebf8-f029-40d4-8f49-88b33b846e2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.895301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6ebf8-f029-40d4-8f49-88b33b846e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0cd6ebf8-f029-40d4-8f49-88b33b846e2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:34.900894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:34.902235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:34.903080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:34.905513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 140/260] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:01:34.914924 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6ebf8-f029-40d4-8f49-88b33b846e2e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.918403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9017045-aa9c-4dac-82e6-ece93c2a18fa None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.927982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:35.042667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a39a-3d95-4462-a22e-b01459f27ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:35.044039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a39a-3d95-4462-a22e-b01459f27ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.044694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a39a-3d95-4462-a22e-b01459f27ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.045188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088a39a-3d95-4462-a22e-b01459f27ac3 None admin] PATH_INFO: `/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.052618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a39a-3d95-4462-a22e-b01459f27ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a74123f5b4e55afb7e5fe5e417f7a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:35.055795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088a39a-3d95-4462-a22e-b01459f27ac3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:35.060256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 121/261] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a => generated 283 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:35.069179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a39a-3d95-4462-a22e-b01459f27ac3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:35.136920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:35.152613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6ebf8-f029-40d4-8f49-88b33b846e2e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:35.250343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:35.252124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.252629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.253160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.254103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:35.254638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:35.256437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:35.271683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 141/262] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:35.280939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:35.342345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088a39a-3d95-4462-a22e-b01459f27ac3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:35.404239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbf3fb-4e57-4bb7-95eb-024d3de90814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:35.404897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbf3fb-4e57-4bb7-95eb-024d3de90814 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.405186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbf3fb-4e57-4bb7-95eb-024d3de90814 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.405466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbf3fb-4e57-4bb7-95eb-024d3de90814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.477166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:35.537330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbf3fb-4e57-4bb7-95eb-024d3de90814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:35.538936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbf3fb-4e57-4bb7-95eb-024d3de90814 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:35.542755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed0fb2-0210-4df2-9b31-dfd19062e8b2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:35.655581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8c8b0-7a88-4bb1-ba38-3394c5ffcc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:35.656520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c8b0-7a88-4bb1-ba38-3394c5ffcc69 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.656997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c8b0-7a88-4bb1-ba38-3394c5ffcc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.657485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c8b0-7a88-4bb1-ba38-3394c5ffcc69 None admin] PATH_INFO: `/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.659650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8c8b0-7a88-4bb1-ba38-3394c5ffcc69 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7a74123f5b4e55afb7e5fe5e417f7a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:35.662486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8c8b0-7a88-4bb1-ba38-3394c5ffcc69 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:35.670425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 142/263] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:35 2022] GET /identity/v3/users/aa7a74123f5b4e55afb7e5fe5e417f7a => generated 283 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:35.672780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716d54-3d02-4c32-afab-e402ca9a5918 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.673270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716d54-3d02-4c32-afab-e402ca9a5918 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.673751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716d54-3d02-4c32-afab-e402ca9a5918 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.676342 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 143/264] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:35.681918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6716d54-3d02-4c32-afab-e402ca9a5918 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:35.727522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 122/265] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:35.728814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce03d-1b3b-48f1-ae34-2ffaffc5c7f4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.729110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce03d-1b3b-48f1-ae34-2ffaffc5c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.729601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce03d-1b3b-48f1-ae34-2ffaffc5c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.750091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:35.778486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-896ce03d-1b3b-48f1-ae34-2ffaffc5c7f4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:35.782792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-896ce03d-1b3b-48f1-ae34-2ffaffc5c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:35.960335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6716d54-3d02-4c32-afab-e402ca9a5918 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.005034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 123/266] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:36.005931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce03d-1b3b-48f1-ae34-2ffaffc5c7f4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:36.008758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:36.053737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b77163-65ff-4852-8a53-ee64ecad6c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:36.054395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77163-65ff-4852-8a53-ee64ecad6c4a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.054677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77163-65ff-4852-8a53-ee64ecad6c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.054952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b77163-65ff-4852-8a53-ee64ecad6c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.229343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b77163-65ff-4852-8a53-ee64ecad6c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:36.235134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b77163-65ff-4852-8a53-ee64ecad6c4a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:36.255465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce03d-1b3b-48f1-ae34-2ffaffc5c7f4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.321254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:36.390513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281af471-e20f-4661-ab70-3a7d20f82f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:36.392562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af471-e20f-4661-ab70-3a7d20f82f69 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.393660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af471-e20f-4661-ab70-3a7d20f82f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.395866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af471-e20f-4661-ab70-3a7d20f82f69 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.398548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281af471-e20f-4661-ab70-3a7d20f82f69 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:36.404035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281af471-e20f-4661-ab70-3a7d20f82f69 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:36.412285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 124/267] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:36 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:36.420476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377cefc-a8ba-4479-8e4b-1ec363fc0c5e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.421780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377cefc-a8ba-4479-8e4b-1ec363fc0c5e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.424535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377cefc-a8ba-4479-8e4b-1ec363fc0c5e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.427460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 125/268] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:36.429404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377cefc-a8ba-4479-8e4b-1ec363fc0c5e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:36.549490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 144/269] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:01:36.552403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a566c-446b-4a49-812b-8088fade1259 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.553220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a566c-446b-4a49-812b-8088fade1259 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.554074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a566c-446b-4a49-812b-8088fade1259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.566962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:36.587737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1c6a566c-446b-4a49-812b-8088fade1259 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:36.590486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1c6a566c-446b-4a49-812b-8088fade1259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:36.642108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377cefc-a8ba-4479-8e4b-1ec363fc0c5e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.710719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:36.711709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.711709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.711975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.712661 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6, user.id=aa7a74123f5b4e55afb7e5fe5e417f7a) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:36.712975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:36.715179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:36.726326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 126/270] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:36 2022] GET /identity/v3/role_assignments?user.id=aa7a74123f5b4e55afb7e5fe5e417f7a&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=b76f0bbd02794923b10af161becac1c6 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:36.728932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:36.742275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 145/271] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:36.744694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a566c-446b-4a49-812b-8088fade1259 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:36.865120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:36.966386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a566c-446b-4a49-812b-8088fade1259 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.984051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b8ec5-7d07-4fb1-a219-c0f6fcb80c5a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.022731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbdc9b-bdc3-45be-bc9d-aab549db1c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.024295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdc9b-bdc3-45be-bc9d-aab549db1c17 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.025061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdc9b-bdc3-45be-bc9d-aab549db1c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.025547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdc9b-bdc3-45be-bc9d-aab549db1c17 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.029689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbdc9b-bdc3-45be-bc9d-aab549db1c17 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.032654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbdc9b-bdc3-45be-bc9d-aab549db1c17 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.035907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 146/272] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:36 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:37.038106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10a5a-dd45-4ecc-9549-beaaafae7bf6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.039379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10a5a-dd45-4ecc-9549-beaaafae7bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.040004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10a5a-dd45-4ecc-9549-beaaafae7bf6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.043050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 147/273] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:37.045273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5446b9-042a-4855-832d-29bce434b591 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.045774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5446b9-042a-4855-832d-29bce434b591 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.046350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5446b9-042a-4855-832d-29bce434b591 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.049043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 148/274] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:37.050584 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5446b9-042a-4855-832d-29bce434b591 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.058587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b38400-0659-41e9-b2d8-1cad734e0b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.059702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b38400-0659-41e9-b2d8-1cad734e0b25 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.060188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b38400-0659-41e9-b2d8-1cad734e0b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.060685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b38400-0659-41e9-b2d8-1cad734e0b25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.063148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:37.077526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b38400-0659-41e9-b2d8-1cad734e0b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-51b38400-0659-41e9-b2d8-1cad734e0b25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:37.083382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:37.085275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 127/275] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:37.087079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7db9-fe5a-43cd-b615-d4552e427ac1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.088425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7db9-fe5a-43cd-b615-d4552e427ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.088425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7db9-fe5a-43cd-b615-d4552e427ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.106488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bebe7db9-fe5a-43cd-b615-d4552e427ac1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:37.107740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bebe7db9-fe5a-43cd-b615-d4552e427ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:37.197656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5446b9-042a-4855-832d-29bce434b591 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.200925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 128/276] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:37.202202 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d4ea-1cc8-4b91-843e-7c3aed6e6591 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.202525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d4ea-1cc8-4b91-843e-7c3aed6e6591 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.202802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d4ea-1cc8-4b91-843e-7c3aed6e6591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.222163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-48e1d4ea-1cc8-4b91-843e-7c3aed6e6591 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:37.223405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-48e1d4ea-1cc8-4b91-843e-7c3aed6e6591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:37.233937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:37.247195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.248371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.248839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.249329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.250423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] RBAC: Adding query filter params (role.id=664110d895074b5a89855c373f794807, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6, user.id=aa7a74123f5b4e55afb7e5fe5e417f7a) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:37.250873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.253103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.274305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 149/277] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/role_assignments?user.id=aa7a74123f5b4e55afb7e5fe5e417f7a&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=664110d895074b5a89855c373f794807 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:37.274305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.340190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 129/278] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:37.341496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1d4ea-1cc8-4b91-843e-7c3aed6e6591 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.464511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:37.488605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1cb44-491b-4ce5-8550-da2fd20fdb2c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.547487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1d4ea-1cc8-4b91-843e-7c3aed6e6591 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.560351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3620dc-0fb2-42f1-958a-9ab0feeae422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.561375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3620dc-0fb2-42f1-958a-9ab0feeae422 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.561855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3620dc-0fb2-42f1-958a-9ab0feeae422 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.563004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3620dc-0fb2-42f1-958a-9ab0feeae422 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.564418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3620dc-0fb2-42f1-958a-9ab0feeae422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.567221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3620dc-0fb2-42f1-958a-9ab0feeae422 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.576658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 150/279] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:37.587474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3620dc-0fb2-42f1-958a-9ab0feeae422 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.623592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.624605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.625071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.625526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.626422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:37.626941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.629223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.640475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 130/280] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:37.653627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.696720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:37.756005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3620dc-0fb2-42f1-958a-9ab0feeae422 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.800780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171dbc9-dafc-4466-8772-781899baf276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.801404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171dbc9-dafc-4466-8772-781899baf276 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.801687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171dbc9-dafc-4466-8772-781899baf276 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.801965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171dbc9-dafc-4466-8772-781899baf276 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.802788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171dbc9-dafc-4466-8772-781899baf276 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.804276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171dbc9-dafc-4466-8772-781899baf276 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.821763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02486e34-a821-4fc1-9044-5f6f729d2666 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.833110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 151/281] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:37 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:37.846712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171dbc9-dafc-4466-8772-781899baf276 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.846866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:37.864009 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430a111-cd41-43e0-8068-4b7f90b10c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.864666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a111-cd41-43e0-8068-4b7f90b10c69 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.864941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a111-cd41-43e0-8068-4b7f90b10c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.865204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430a111-cd41-43e0-8068-4b7f90b10c69 None admin] PATH_INFO: `/v3/users/a5c68c88b7674be78e4fe4af30f572b2` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.883609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430a111-cd41-43e0-8068-4b7f90b10c69 None admin] RBAC: Authorizing `identity:get_user(user_id=a5c68c88b7674be78e4fe4af30f572b2)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.885779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430a111-cd41-43e0-8068-4b7f90b10c69 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.888086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 131/282] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/users/a5c68c88b7674be78e4fe4af30f572b2 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:37.889603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430a111-cd41-43e0-8068-4b7f90b10c69 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.997335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171dbc9-dafc-4466-8772-781899baf276 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.015161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.035308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430a111-cd41-43e0-8068-4b7f90b10c69 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.045131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fda73-ced7-4efd-b9a8-7976357724cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.045790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fda73-ced7-4efd-b9a8-7976357724cb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.046070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fda73-ced7-4efd-b9a8-7976357724cb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.046391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fda73-ced7-4efd-b9a8-7976357724cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.060177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fda73-ced7-4efd-b9a8-7976357724cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a59fda73-ced7-4efd-b9a8-7976357724cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:38.065579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:38.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:38.067581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 152/283] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:38.068230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fda73-ced7-4efd-b9a8-7976357724cb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.094758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389fd88-f94e-4761-a452-3b2cc24d9155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.095422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389fd88-f94e-4761-a452-3b2cc24d9155 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.095712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389fd88-f94e-4761-a452-3b2cc24d9155 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.095991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389fd88-f94e-4761-a452-3b2cc24d9155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.111861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389fd88-f94e-4761-a452-3b2cc24d9155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b389fd88-f94e-4761-a452-3b2cc24d9155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:38.124442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:38.126470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 132/284] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:38.127972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389fd88-f94e-4761-a452-3b2cc24d9155 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.191629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.241975 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fda73-ced7-4efd-b9a8-7976357724cb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.305250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389fd88-f94e-4761-a452-3b2cc24d9155 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.308764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.309508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.309893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.310247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.311108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] RBAC: Adding query filter params (role.id=af32346e85724870afa2c6aee5b285ed, user.id=a5c68c88b7674be78e4fe4af30f572b2, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:38.311495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:38.313093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:38.321790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 153/285] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/role_assignments?user.id=a5c68c88b7674be78e4fe4af30f572b2&scope.system=all&role.id=af32346e85724870afa2c6aee5b285ed => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:38.322522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.354914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.355887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.356327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.356776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.357665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:38.358138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:38.359806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:38.371116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 133/286] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:38.379281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.402319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.572395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f729653-97b5-4a78-893c-adad6212ae85 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.648872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.650384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.651055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.652284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.654541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:38.655502 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:38.657435 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.659402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:38.666524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21385a-a274-46ce-a530-f0c5aea107e3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.694064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 154/287] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:38.712698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.714960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859e21-ed06-4d2e-ad98-76ee7ece7685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.715900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859e21-ed06-4d2e-ad98-76ee7ece7685 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.716413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859e21-ed06-4d2e-ad98-76ee7ece7685 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.716899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859e21-ed06-4d2e-ad98-76ee7ece7685 None admin] PATH_INFO: `/v3/users/69ad76c8a4aa4eeb9022c4a05c71bfe7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.718423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a859e21-ed06-4d2e-ad98-76ee7ece7685 None admin] RBAC: Authorizing `identity:get_user(user_id=69ad76c8a4aa4eeb9022c4a05c71bfe7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:38.720186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a859e21-ed06-4d2e-ad98-76ee7ece7685 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:38.722471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 134/288] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/users/69ad76c8a4aa4eeb9022c4a05c71bfe7 => generated 297 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:38.732453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859e21-ed06-4d2e-ad98-76ee7ece7685 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.937864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859e21-ed06-4d2e-ad98-76ee7ece7685 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.976608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.985227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17d26-1a72-42d0-8505-102bd92a2dcf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:39.025032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f0ac7-16be-4bc4-97db-86a7390ac723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.026067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f0ac7-16be-4bc4-97db-86a7390ac723 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.027099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f0ac7-16be-4bc4-97db-86a7390ac723 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.027581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f0ac7-16be-4bc4-97db-86a7390ac723 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.032995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f0ac7-16be-4bc4-97db-86a7390ac723 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.035789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f0ac7-16be-4bc4-97db-86a7390ac723 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.046799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 135/289] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:39.074721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f0ac7-16be-4bc4-97db-86a7390ac723 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:39.105765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90868f57-2106-421e-b427-d38ed7f3cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.106852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868f57-2106-421e-b427-d38ed7f3cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.107307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868f57-2106-421e-b427-d38ed7f3cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.107764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868f57-2106-421e-b427-d38ed7f3cdb7 None admin] PATH_INFO: `/v3/users/4ee83a3a9a2e4291a7b895e383450ead` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.109773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90868f57-2106-421e-b427-d38ed7f3cdb7 None admin] RBAC: Authorizing `identity:get_user(user_id=4ee83a3a9a2e4291a7b895e383450ead)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.112496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90868f57-2106-421e-b427-d38ed7f3cdb7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.117722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 155/290] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/users/4ee83a3a9a2e4291a7b895e383450ead => generated 297 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:39.131983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90868f57-2106-421e-b427-d38ed7f3cdb7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:39.146857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:39.222067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f0ac7-16be-4bc4-97db-86a7390ac723 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:39.329420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90868f57-2106-421e-b427-d38ed7f3cdb7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:39.368541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2f662-8cc5-458d-8c8b-b6070723a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.369248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f662-8cc5-458d-8c8b-b6070723a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.369535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f662-8cc5-458d-8c8b-b6070723a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.369815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f662-8cc5-458d-8c8b-b6070723a4d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.371853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6493f07-9afc-4c6a-a5c1-bdce35c39752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.372987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6493f07-9afc-4c6a-a5c1-bdce35c39752 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.373823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6493f07-9afc-4c6a-a5c1-bdce35c39752 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.374340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6493f07-9afc-4c6a-a5c1-bdce35c39752 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/users/69ad76c8a4aa4eeb9022c4a05c71bfe7/roles/17ed2a44e14a4da180fe4f88ed7568b3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.383644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6493f07-9afc-4c6a-a5c1-bdce35c39752 None admin] RBAC: Authorizing `identity:create_grant(project_id=d802ed4ff9094e3d8e405ce3457077c6, user_id=69ad76c8a4aa4eeb9022c4a05c71bfe7, role_id=17ed2a44e14a4da180fe4f88ed7568b3)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.386912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6493f07-9afc-4c6a-a5c1-bdce35c39752 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.416981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:39.452576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2f662-8cc5-458d-8c8b-b6070723a4d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.454127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2f662-8cc5-458d-8c8b-b6070723a4d2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.478366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 136/291] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:39 2022] PUT /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/users/69ad76c8a4aa4eeb9022c4a05c71bfe7/roles/17ed2a44e14a4da180fe4f88ed7568b3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:39.634494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 156/292] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:39.641102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6493f07-9afc-4c6a-a5c1-bdce35c39752 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:39.874741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:39.896729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6493f07-9afc-4c6a-a5c1-bdce35c39752 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:39.950833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e7e29-bbc4-460a-adf0-9b2e988b8610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.951503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e7e29-bbc4-460a-adf0-9b2e988b8610 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.951782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e7e29-bbc4-460a-adf0-9b2e988b8610 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.952066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e7e29-bbc4-460a-adf0-9b2e988b8610 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.953401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e7e29-bbc4-460a-adf0-9b2e988b8610 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.954929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e7e29-bbc4-460a-adf0-9b2e988b8610 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.956980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 137/293] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:39 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:39.966379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2f662-8cc5-458d-8c8b-b6070723a4d2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:40.175456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:40.243732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2f662-8cc5-458d-8c8b-b6070723a4d2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:40.315607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efb330-8190-42de-9475-7e94ec91e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:40.316685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efb330-8190-42de-9475-7e94ec91e72f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:40.317185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efb330-8190-42de-9475-7e94ec91e72f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:40.317678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efb330-8190-42de-9475-7e94ec91e72f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:40.319299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efb330-8190-42de-9475-7e94ec91e72f None admin] RBAC: Adding query filter params (role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6, user.id=4ee83a3a9a2e4291a7b895e383450ead) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:40.319873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efb330-8190-42de-9475-7e94ec91e72f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:40.322768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efb330-8190-42de-9475-7e94ec91e72f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:40.334671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 157/294] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:39 2022] GET /identity/v3/role_assignments?user.id=4ee83a3a9a2e4291a7b895e383450ead&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=af32346e85724870afa2c6aee5b285ed => generated 608 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:41.150008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc199df-43fe-4675-836a-de794bbe60ae None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.151132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc199df-43fe-4675-836a-de794bbe60ae None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.152282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc199df-43fe-4675-836a-de794bbe60ae None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.154246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 138/295] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:41.160020 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf13c3-6a99-4cf6-a6c3-5e107b5e0c67 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.160958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf13c3-6a99-4cf6-a6c3-5e107b5e0c67 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.161451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf13c3-6a99-4cf6-a6c3-5e107b5e0c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.181710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5dbf13c3-6a99-4cf6-a6c3-5e107b5e0c67 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:41.184114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5dbf13c3-6a99-4cf6-a6c3-5e107b5e0c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:41.264286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 158/296] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:41.425438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e05d-938d-41fe-96c0-94eb6ff38217 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.426114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e05d-938d-41fe-96c0-94eb6ff38217 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.426628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e05d-938d-41fe-96c0-94eb6ff38217 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.428204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 139/297] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:41.434573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dd20f-4c0b-4270-ac92-4715933b9ee5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.435183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dd20f-4c0b-4270-ac92-4715933b9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.435664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dd20f-4c0b-4270-ac92-4715933b9ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.459359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ad0dd20f-4c0b-4270-ac92-4715933b9ee5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:41.460820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ad0dd20f-4c0b-4270-ac92-4715933b9ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:41.535445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:41.547011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 159/298] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:41.552082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6e05d-938d-41fe-96c0-94eb6ff38217 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:41.666593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6e05d-938d-41fe-96c0-94eb6ff38217 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:41.696764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8bac-0130-4471-b48c-9932473322e8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.697677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8bac-0130-4471-b48c-9932473322e8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.698541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8bac-0130-4471-b48c-9932473322e8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.707654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 160/299] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:41.707888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f108e1-54f8-477b-855a-f14c6cdbc758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:41.707888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f108e1-54f8-477b-855a-f14c6cdbc758 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.707888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f108e1-54f8-477b-855a-f14c6cdbc758 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.707888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f108e1-54f8-477b-855a-f14c6cdbc758 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.711702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72847c24-b180-4a46-a738-c49132569593 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.712503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72847c24-b180-4a46-a738-c49132569593 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.713270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72847c24-b180-4a46-a738-c49132569593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.719406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f108e1-54f8-477b-855a-f14c6cdbc758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-02f108e1-54f8-477b-855a-f14c6cdbc758 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:41.724844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:41.726880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:41.728689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 140/300] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:41.732567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f108e1-54f8-477b-855a-f14c6cdbc758 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:41.753994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-72847c24-b180-4a46-a738-c49132569593 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:41.756503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-72847c24-b180-4a46-a738-c49132569593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:41.758682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:41.861090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f108e1-54f8-477b-855a-f14c6cdbc758 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:41.901123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 161/301] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:41.901123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72847c24-b180-4a46-a738-c49132569593 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:41.907752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:41.908385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.908671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.908949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.909635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:41.909940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:41.911388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:41.921826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 141/302] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:41.930344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.054687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72847c24-b180-4a46-a738-c49132569593 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.091342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.104484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.125312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6496-4d53-4fb7-b091-33d84a025277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.125971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6496-4d53-4fb7-b091-33d84a025277 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.126080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689671f-64e1-4b53-9e34-966bc4716bc5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.126300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6496-4d53-4fb7-b091-33d84a025277 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.126568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6496-4d53-4fb7-b091-33d84a025277 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.140742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d6496-4d53-4fb7-b091-33d84a025277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-df4d6496-4d53-4fb7-b091-33d84a025277 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:42.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:42.147152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:42.147950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 162/303] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:42.150841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f02c-074f-4666-9e44-2be3a8cb4fc3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.151502 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f02c-074f-4666-9e44-2be3a8cb4fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.152651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f02c-074f-4666-9e44-2be3a8cb4fc3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.154547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 163/304] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:42.158844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665f02c-074f-4666-9e44-2be3a8cb4fc3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.174372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef458d31-0b81-4b25-8bde-ce312384fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.175025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef458d31-0b81-4b25-8bde-ce312384fb1d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.175381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef458d31-0b81-4b25-8bde-ce312384fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.175573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef458d31-0b81-4b25-8bde-ce312384fb1d None admin] PATH_INFO: `/v3/users/a36c6ef30a7f4498971f186af9fcb0f7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.197229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef458d31-0b81-4b25-8bde-ce312384fb1d None admin] RBAC: Authorizing `identity:get_user(user_id=a36c6ef30a7f4498971f186af9fcb0f7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.203976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef458d31-0b81-4b25-8bde-ce312384fb1d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:42.203976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 142/305] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:41 2022] GET /identity/v3/users/a36c6ef30a7f4498971f186af9fcb0f7 => generated 293 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:42.205740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176260e7-3e56-4332-96c2-423646677904 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.206327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176260e7-3e56-4332-96c2-423646677904 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.206796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176260e7-3e56-4332-96c2-423646677904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.237225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-176260e7-3e56-4332-96c2-423646677904 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:42.238607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-176260e7-3e56-4332-96c2-423646677904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:42.325333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665f02c-074f-4666-9e44-2be3a8cb4fc3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.341888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 143/306] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:42.343204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176260e7-3e56-4332-96c2-423646677904 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.386397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.387849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.388469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.388972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.390139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:42.390955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.393571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:42.409154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 164/307] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:42.410142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.440872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.486374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.506754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176260e7-3e56-4332-96c2-423646677904 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.568345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.569511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.569893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d9fdc-28ba-4127-9daa-7800f73e899e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.570068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.570495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.571920 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] RBAC: Adding query filter params (role.id=17ed2a44e14a4da180fe4f88ed7568b3, user.id=a36c6ef30a7f4498971f186af9fcb0f7, scope.system=all) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:42.572471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.575985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:42.585834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 144/308] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/role_assignments?user.id=a36c6ef30a7f4498971f186af9fcb0f7&scope.system=all&role.id=17ed2a44e14a4da180fe4f88ed7568b3 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:42.592044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.634378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c17fdd-5cd2-46bd-a5c4-cd89c058f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.635427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c17fdd-5cd2-46bd-a5c4-cd89c058f462 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.636443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c17fdd-5cd2-46bd-a5c4-cd89c058f462 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.636880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c17fdd-5cd2-46bd-a5c4-cd89c058f462 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.639141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c17fdd-5cd2-46bd-a5c4-cd89c058f462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.641722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c17fdd-5cd2-46bd-a5c4-cd89c058f462 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:42.644689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 165/309] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:42.645907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c17fdd-5cd2-46bd-a5c4-cd89c058f462 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.730290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252715c-2cff-4602-87d8-e61db9405267 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.775882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7191-87f1-44eb-9dd8-e1dab5f262c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.776674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7191-87f1-44eb-9dd8-e1dab5f262c9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.777081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7191-87f1-44eb-9dd8-e1dab5f262c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.777462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee7191-87f1-44eb-9dd8-e1dab5f262c9 None admin] PATH_INFO: `/v3/users/a5c68c88b7674be78e4fe4af30f572b2` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.779093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee7191-87f1-44eb-9dd8-e1dab5f262c9 None admin] RBAC: Authorizing `identity:get_user(user_id=a5c68c88b7674be78e4fe4af30f572b2)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.780600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee7191-87f1-44eb-9dd8-e1dab5f262c9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:42.782344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 145/310] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/users/a5c68c88b7674be78e4fe4af30f572b2 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:42.788433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7191-87f1-44eb-9dd8-e1dab5f262c9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.793037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.799768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c17fdd-5cd2-46bd-a5c4-cd89c058f462 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.816573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.843858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee4415-d865-4fff-b0ca-0d7c10fe90f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.844422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4415-d865-4fff-b0ca-0d7c10fe90f9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.844701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4415-d865-4fff-b0ca-0d7c10fe90f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.844974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee4415-d865-4fff-b0ca-0d7c10fe90f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.859425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee4415-d865-4fff-b0ca-0d7c10fe90f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-55ee4415-d865-4fff-b0ca-0d7c10fe90f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:42.871317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:42.872409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:42.873212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:42.876325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 166/311] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:42.877781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee4415-d865-4fff-b0ca-0d7c10fe90f9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.927709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee7191-87f1-44eb-9dd8-e1dab5f262c9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.967407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3ce46-04f2-45e5-9b6f-ccad49c67d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.968056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3ce46-04f2-45e5-9b6f-ccad49c67d59 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.968333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3ce46-04f2-45e5-9b6f-ccad49c67d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.968604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3ce46-04f2-45e5-9b6f-ccad49c67d59 None admin] PATH_INFO: `/v3/groups` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.969243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3ce46-04f2-45e5-9b6f-ccad49c67d59 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.970726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3ce46-04f2-45e5-9b6f-ccad49c67d59 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:43.002299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 146/312] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Sep 1 08:01:42 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:43.002299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3ce46-04f2-45e5-9b6f-ccad49c67d59 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:43.062023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee4415-d865-4fff-b0ca-0d7c10fe90f9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.107337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:43.154233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d744a-097f-45d4-8426-ee23646cd50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:43.156123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d744a-097f-45d4-8426-ee23646cd50a None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.156826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d744a-097f-45d4-8426-ee23646cd50a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.157764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d744a-097f-45d4-8426-ee23646cd50a None admin] PATH_INFO: `/v3/system/users/a5c68c88b7674be78e4fe4af30f572b2/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.161638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d744a-097f-45d4-8426-ee23646cd50a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a5c68c88b7674be78e4fe4af30f572b2, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:43.165379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d744a-097f-45d4-8426-ee23646cd50a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:43.175928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3ce46-04f2-45e5-9b6f-ccad49c67d59 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.186377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 167/313] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Sep 1 08:01:42 2022] PUT /identity/v3/system/users/a5c68c88b7674be78e4fe4af30f572b2/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:43.253514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:43.254372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.254854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.255338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.256592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:43.257118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:43.258782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:43.270026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 147/314] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:43.278836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d744a-097f-45d4-8426-ee23646cd50a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:43.345600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:43.496140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d744a-097f-45d4-8426-ee23646cd50a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.561823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65052f4-9781-43dc-8271-45990bb69f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:43.563518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65052f4-9781-43dc-8271-45990bb69f18 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.564464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65052f4-9781-43dc-8271-45990bb69f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.565181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65052f4-9781-43dc-8271-45990bb69f18 None admin] PATH_INFO: `/v3/users/69ad76c8a4aa4eeb9022c4a05c71bfe7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.567631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65052f4-9781-43dc-8271-45990bb69f18 None admin] RBAC: Authorizing `identity:get_user(user_id=69ad76c8a4aa4eeb9022c4a05c71bfe7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:43.570741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65052f4-9781-43dc-8271-45990bb69f18 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:43.575119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 168/315] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:43 2022] GET /identity/v3/users/69ad76c8a4aa4eeb9022c4a05c71bfe7 => generated 297 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:43.584497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:43.788329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c992f5-081f-48f9-a7ff-e5ed14d559d8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.833723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:43.856198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aede0-fbfb-42f8-8d37-b08d44d8b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:43.857751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aede0-fbfb-42f8-8d37-b08d44d8b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.858558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aede0-fbfb-42f8-8d37-b08d44d8b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.859315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aede0-fbfb-42f8-8d37-b08d44d8b3d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.992472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aede0-fbfb-42f8-8d37-b08d44d8b3d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:43.996344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aede0-fbfb-42f8-8d37-b08d44d8b3d0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:44.208579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 148/316] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:44.224131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65052f4-9781-43dc-8271-45990bb69f18 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:44.424365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65052f4-9781-43dc-8271-45990bb69f18 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:44.432298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:44.506060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621e971-7184-42af-8d2e-cc4b440953b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:44.507146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621e971-7184-42af-8d2e-cc4b440953b6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.507694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621e971-7184-42af-8d2e-cc4b440953b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.508169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621e971-7184-42af-8d2e-cc4b440953b6 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.510360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621e971-7184-42af-8d2e-cc4b440953b6 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:44.513783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621e971-7184-42af-8d2e-cc4b440953b6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:44.517361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 169/317] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:44 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:44.527605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aede0-fbfb-42f8-8d37-b08d44d8b3d0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:44.583468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:44.738613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aede0-fbfb-42f8-8d37-b08d44d8b3d0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:44.806301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21e47-92bf-4410-8ad2-e8233134c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:44.807324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21e47-92bf-4410-8ad2-e8233134c4ab None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.809136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21e47-92bf-4410-8ad2-e8233134c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.809638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21e47-92bf-4410-8ad2-e8233134c4ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.811081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21e47-92bf-4410-8ad2-e8233134c4ab None admin] RBAC: Adding query filter params (role.id=17ed2a44e14a4da180fe4f88ed7568b3, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6, user.id=69ad76c8a4aa4eeb9022c4a05c71bfe7) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:44.811639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21e47-92bf-4410-8ad2-e8233134c4ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:44.814444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21e47-92bf-4410-8ad2-e8233134c4ab None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:44.828244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 149/318] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:44 2022] GET /identity/v3/role_assignments?user.id=69ad76c8a4aa4eeb9022c4a05c71bfe7&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=17ed2a44e14a4da180fe4f88ed7568b3 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:45.504691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f05d-9ce9-4327-be2d-5cd61faa1caf None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.505277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f05d-9ce9-4327-be2d-5cd61faa1caf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.505277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f05d-9ce9-4327-be2d-5cd61faa1caf None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.506832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 170/319] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:45.512627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bfc74-824f-4141-b828-8d8b72ed7444 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.513362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bfc74-824f-4141-b828-8d8b72ed7444 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.513362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bfc74-824f-4141-b828-8d8b72ed7444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.534392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ab3bfc74-824f-4141-b828-8d8b72ed7444 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:45.535667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ab3bfc74-824f-4141-b828-8d8b72ed7444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:45.618627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 150/320] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:45.644087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49252b-9e73-422f-b497-f8185f231218 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.644397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49252b-9e73-422f-b497-f8185f231218 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.644637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49252b-9e73-422f-b497-f8185f231218 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.646123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 171/321] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:45.651902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b159d-3433-4360-b203-0d767e5c8dbf None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.652220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b159d-3433-4360-b203-0d767e5c8dbf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.652469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b159d-3433-4360-b203-0d767e5c8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.678025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-908b159d-3433-4360-b203-0d767e5c8dbf None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:45.680147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-908b159d-3433-4360-b203-0d767e5c8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:45.704805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:45.721292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a275-fe26-4df8-82c5-4d661ca1b5c6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.721578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a275-fe26-4df8-82c5-4d661ca1b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.721850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a275-fe26-4df8-82c5-4d661ca1b5c6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.723520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 172/322] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:45.728480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3223491-5294-4d34-834a-61a1fe2d4f49 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.728762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3223491-5294-4d34-834a-61a1fe2d4f49 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.729035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3223491-5294-4d34-834a-61a1fe2d4f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.750452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d3223491-5294-4d34-834a-61a1fe2d4f49 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:45.751651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d3223491-5294-4d34-834a-61a1fe2d4f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:45.782302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 151/323] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:45.831655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 173/324] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:45.892750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b159d-3433-4360-b203-0d767e5c8dbf None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.023497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b159d-3433-4360-b203-0d767e5c8dbf None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.063927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46155544-3ecf-41f9-8850-d84af3dfe414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.064173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3223491-5294-4d34-834a-61a1fe2d4f49 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.064743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155544-3ecf-41f9-8850-d84af3dfe414 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.065223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155544-3ecf-41f9-8850-d84af3dfe414 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.065519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155544-3ecf-41f9-8850-d84af3dfe414 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.066761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46155544-3ecf-41f9-8850-d84af3dfe414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.068218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46155544-3ecf-41f9-8850-d84af3dfe414 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.069978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 152/325] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.075587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46155544-3ecf-41f9-8850-d84af3dfe414 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.099153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.192011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3223491-5294-4d34-834a-61a1fe2d4f49 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.193597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.204000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46155544-3ecf-41f9-8850-d84af3dfe414 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.230885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968be541-f77f-4b85-a2aa-fbfa34c409e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.231526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968be541-f77f-4b85-a2aa-fbfa34c409e1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.231876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968be541-f77f-4b85-a2aa-fbfa34c409e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.232175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968be541-f77f-4b85-a2aa-fbfa34c409e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.243102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968be541-f77f-4b85-a2aa-fbfa34c409e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:46.248018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30894c98-0049-497b-9f7e-1531f54c0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.248631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30894c98-0049-497b-9f7e-1531f54c0874 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-968be541-f77f-4b85-a2aa-fbfa34c409e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:46.248733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:46.249663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:46.250499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:46.251693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30894c98-0049-497b-9f7e-1531f54c0874 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.251693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30894c98-0049-497b-9f7e-1531f54c0874 None admin] PATH_INFO: `/v3/groups` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.251693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30894c98-0049-497b-9f7e-1531f54c0874 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.251901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 174/326] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:01:46.251901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968be541-f77f-4b85-a2aa-fbfa34c409e1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.252060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30894c98-0049-497b-9f7e-1531f54c0874 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.269201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 153/327] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Sep 1 08:01:46 2022] POST /identity/v3/groups => generated 226 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:01:46.270051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30894c98-0049-497b-9f7e-1531f54c0874 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.388541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968be541-f77f-4b85-a2aa-fbfa34c409e1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.396269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.435734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689eeb-8579-4e54-987a-4afea03cfd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.436034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30894c98-0049-497b-9f7e-1531f54c0874 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.438495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689eeb-8579-4e54-987a-4afea03cfd29 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.438495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689eeb-8579-4e54-987a-4afea03cfd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.438495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689eeb-8579-4e54-987a-4afea03cfd29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.453429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c689eeb-8579-4e54-987a-4afea03cfd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1c689eeb-8579-4e54-987a-4afea03cfd29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:46.457810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:46.458749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:46.459562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 175/328] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:46.466773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689eeb-8579-4e54-987a-4afea03cfd29 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.493202 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.494558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.495054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.495663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.496352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:46.496661 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.499997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.500616 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.508764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 154/329] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.514629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.627188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689eeb-8579-4e54-987a-4afea03cfd29 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.665319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49751-0a1a-4ad3-b049-afb8096b7dd0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.673166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.673807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.674088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.674395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.675087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:46.675396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.676824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.691167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 176/330] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:46.697187 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.725233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7e2b-6056-450b-8224-b41dea67d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.726401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7e2b-6056-450b-8224-b41dea67d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.727068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7e2b-6056-450b-8224-b41dea67d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.727535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7e2b-6056-450b-8224-b41dea67d7f9 None admin] PATH_INFO: `/v3/users/a36c6ef30a7f4498971f186af9fcb0f7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.729179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca7e2b-6056-450b-8224-b41dea67d7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=a36c6ef30a7f4498971f186af9fcb0f7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.732484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca7e2b-6056-450b-8224-b41dea67d7f9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.735626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 155/331] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/users/a36c6ef30a7f4498971f186af9fcb0f7 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:46.747553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7e2b-6056-450b-8224-b41dea67d7f9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.765926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.844188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.878653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494ec69-5d56-43a6-a45c-d13fe6c19c04 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.940631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7e2b-6056-450b-8224-b41dea67d7f9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.952580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d435f-f6a8-49b4-b43d-033bd38330d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.955480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d435f-f6a8-49b4-b43d-033bd38330d6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.956569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d435f-f6a8-49b4-b43d-033bd38330d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.957315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d435f-f6a8-49b4-b43d-033bd38330d6 None admin] PATH_INFO: `/v3/users/a5c68c88b7674be78e4fe4af30f572b2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.960094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d435f-f6a8-49b4-b43d-033bd38330d6 None admin] RBAC: Authorizing `identity:get_user(user_id=a5c68c88b7674be78e4fe4af30f572b2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.962847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d435f-f6a8-49b4-b43d-033bd38330d6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.965331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 177/332] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/users/a5c68c88b7674be78e4fe4af30f572b2 => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.975373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d435f-f6a8-49b4-b43d-033bd38330d6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.998983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9e9b5-b62e-47af-a8d5-08aec7b38419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:47.000510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9e9b5-b62e-47af-a8d5-08aec7b38419 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:47.001221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9e9b5-b62e-47af-a8d5-08aec7b38419 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:47.001883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9e9b5-b62e-47af-a8d5-08aec7b38419 None admin] PATH_INFO: `/v3/system/users/a36c6ef30a7f4498971f186af9fcb0f7/roles/17ed2a44e14a4da180fe4f88ed7568b3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:47.004738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9e9b5-b62e-47af-a8d5-08aec7b38419 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a36c6ef30a7f4498971f186af9fcb0f7, role_id=17ed2a44e14a4da180fe4f88ed7568b3)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:47.007137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9e9b5-b62e-47af-a8d5-08aec7b38419 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:47.024264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 156/333] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Sep 1 08:01:46 2022] PUT /identity/v3/system/users/a36c6ef30a7f4498971f186af9fcb0f7/roles/17ed2a44e14a4da180fe4f88ed7568b3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:47.130768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d435f-f6a8-49b4-b43d-033bd38330d6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:47.193005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700106b-2d9d-4059-96ba-4fdaaa7c62af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:47.194564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700106b-2d9d-4059-96ba-4fdaaa7c62af None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:47.195332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700106b-2d9d-4059-96ba-4fdaaa7c62af None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:47.196057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700106b-2d9d-4059-96ba-4fdaaa7c62af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:47.197744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700106b-2d9d-4059-96ba-4fdaaa7c62af None admin] RBAC: Adding query filter params (role.id=af32346e85724870afa2c6aee5b285ed, user.id=a5c68c88b7674be78e4fe4af30f572b2, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:47.199211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700106b-2d9d-4059-96ba-4fdaaa7c62af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:47.202461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700106b-2d9d-4059-96ba-4fdaaa7c62af None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:47.225850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 178/334] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/role_assignments?user.id=a5c68c88b7674be78e4fe4af30f572b2&scope.system=all&role.id=af32346e85724870afa2c6aee5b285ed => generated 510 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:49.003165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6ea0-db62-4ac2-b378-c20154c55f6d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:49.003900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6ea0-db62-4ac2-b378-c20154c55f6d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:49.004059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6ea0-db62-4ac2-b378-c20154c55f6d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:49.006980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 157/335] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:49.017211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91bc4c-d1db-453f-b287-8af7726f2dfd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:49.017968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91bc4c-d1db-453f-b287-8af7726f2dfd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:49.018346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91bc4c-d1db-453f-b287-8af7726f2dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:49.060108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2f91bc4c-d1db-453f-b287-8af7726f2dfd None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:49.062138 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f91bc4c-d1db-453f-b287-8af7726f2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:49.067507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:49.222522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 179/336] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:49.571174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1cf53-3fb8-489d-8696-71d03371168d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:49.572256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1cf53-3fb8-489d-8696-71d03371168d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:49.573127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1cf53-3fb8-489d-8696-71d03371168d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:49.576525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 158/337] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:49.582295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec47cd-e30f-4c6f-a8b0-efe162527ff7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:49.582572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec47cd-e30f-4c6f-a8b0-efe162527ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:49.583092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec47cd-e30f-4c6f-a8b0-efe162527ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:49.609107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a7ec47cd-e30f-4c6f-a8b0-efe162527ff7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:49.610613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a7ec47cd-e30f-4c6f-a8b0-efe162527ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:49.703124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 180/338] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:49.780095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f215-ee3e-44b7-a5d3-e30f2ab1c69b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:49.780598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f215-ee3e-44b7-a5d3-e30f2ab1c69b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:49.781102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f215-ee3e-44b7-a5d3-e30f2ab1c69b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:49.783804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 159/339] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:49.791724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277dbcb-d763-497c-b367-0015346c6db3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:49.792884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277dbcb-d763-497c-b367-0015346c6db3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:49.793370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277dbcb-d763-497c-b367-0015346c6db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:49.828670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f277dbcb-d763-497c-b367-0015346c6db3 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:49.830444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f277dbcb-d763-497c-b367-0015346c6db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:49.978597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:49.988002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 181/340] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:50.293858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f215-ee3e-44b7-a5d3-e30f2ab1c69b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:50.455806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:50.520465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f215-ee3e-44b7-a5d3-e30f2ab1c69b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:50.536605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277dbcb-d763-497c-b367-0015346c6db3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:50.587229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb6095-d1e0-4de9-afef-c9affdee6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:50.587776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6095-d1e0-4de9-afef-c9affdee6f3b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:50.588065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6095-d1e0-4de9-afef-c9affdee6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:50.588343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb6095-d1e0-4de9-afef-c9affdee6f3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:50.616187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb6095-d1e0-4de9-afef-c9affdee6f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-05cb6095-d1e0-4de9-afef-c9affdee6f3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:50.622905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:50.624910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:50.626835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 160/341] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:50.635309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb6095-d1e0-4de9-afef-c9affdee6f3b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:50.871065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277dbcb-d763-497c-b367-0015346c6db3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:50.880552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb6095-d1e0-4de9-afef-c9affdee6f3b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:50.947801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d09a1-8e6e-4cb9-a1ca-0355d2ec8d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:50.949871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d09a1-8e6e-4cb9-a1ca-0355d2ec8d57 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:50.950632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d09a1-8e6e-4cb9-a1ca-0355d2ec8d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:50.951319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d09a1-8e6e-4cb9-a1ca-0355d2ec8d57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:50.962688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:50.968340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5f120-e003-4335-b103-7870dba59c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:50.969205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f120-e003-4335-b103-7870dba59c7d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:50.969457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f120-e003-4335-b103-7870dba59c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:50.969829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f120-e003-4335-b103-7870dba59c7d None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:50.970654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5f120-e003-4335-b103-7870dba59c7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:50.971058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5f120-e003-4335-b103-7870dba59c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:50.972730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5f120-e003-4335-b103-7870dba59c7d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:50.975993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d09a1-8e6e-4cb9-a1ca-0355d2ec8d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:50.984598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 161/342] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:50.986596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a96f2-012b-4408-98b5-e286a41e8d89 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:50.986596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a96f2-012b-4408-98b5-e286a41e8d89 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:50.986925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a96f2-012b-4408-98b5-e286a41e8d89 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:50.988651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 162/343] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:50.989514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a96f2-012b-4408-98b5-e286a41e8d89 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-074d09a1-8e6e-4cb9-a1ca-0355d2ec8d57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:50.990406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:50.992110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:50.993972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:50.997953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 182/344] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:50.999887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d09a1-8e6e-4cb9-a1ca-0355d2ec8d57 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:51.082769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:51.167691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a96f2-012b-4408-98b5-e286a41e8d89 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:51.187224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d09a1-8e6e-4cb9-a1ca-0355d2ec8d57 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:51.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48209be-815c-4aeb-b92e-e1a6c183126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:51.217112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48209be-815c-4aeb-b92e-e1a6c183126e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.217399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48209be-815c-4aeb-b92e-e1a6c183126e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.217675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48209be-815c-4aeb-b92e-e1a6c183126e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.237002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48209be-815c-4aeb-b92e-e1a6c183126e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f48209be-815c-4aeb-b92e-e1a6c183126e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:51.243751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:51.244720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:51.245613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:51.246240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 163/345] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:51.249307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a623ec-77b1-4040-b54e-376065b5c9c1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.249561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a623ec-77b1-4040-b54e-376065b5c9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.249823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a623ec-77b1-4040-b54e-376065b5c9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.262444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f67c03-e598-416e-801d-2cbda88b11fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:51.263404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f67c03-e598-416e-801d-2cbda88b11fe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.264260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f67c03-e598-416e-801d-2cbda88b11fe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.264260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f67c03-e598-416e-801d-2cbda88b11fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.272733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-92a623ec-77b1-4040-b54e-376065b5c9c1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:51.273998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-92a623ec-77b1-4040-b54e-376065b5c9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:51.364637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:51.407093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f67c03-e598-416e-801d-2cbda88b11fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:51.410246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f67c03-e598-416e-801d-2cbda88b11fe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:51.412165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 164/346] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:51.413930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a623ec-77b1-4040-b54e-376065b5c9c1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:51.538041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:51.588097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a623ec-77b1-4040-b54e-376065b5c9c1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:51.604055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 183/347] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:51.606463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebe6a7-4d79-446a-a612-66dbc033ed9e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.606990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebe6a7-4d79-446a-a612-66dbc033ed9e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.607459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebe6a7-4d79-446a-a612-66dbc033ed9e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.609465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 184/348] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:51.610476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebe6a7-4d79-446a-a612-66dbc033ed9e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:51.637836 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e8e11-ca80-4a9d-96fc-e3f08e7a9deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:51.639247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e8e11-ca80-4a9d-96fc-e3f08e7a9deb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.639788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e8e11-ca80-4a9d-96fc-e3f08e7a9deb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.640755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e8e11-ca80-4a9d-96fc-e3f08e7a9deb None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.641835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e8e11-ca80-4a9d-96fc-e3f08e7a9deb None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:51.642413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e8e11-ca80-4a9d-96fc-e3f08e7a9deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:51.644836 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e8e11-ca80-4a9d-96fc-e3f08e7a9deb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:51.658195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 165/349] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:51.659803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fedf7-3a61-4acd-a58b-2b55667e9fc8 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.659803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fedf7-3a61-4acd-a58b-2b55667e9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.659803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fedf7-3a61-4acd-a58b-2b55667e9fc8 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.661670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 166/350] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:51.662617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fedf7-3a61-4acd-a58b-2b55667e9fc8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:51.742187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:51.790071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebe6a7-4d79-446a-a612-66dbc033ed9e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:51.839435 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fedf7-3a61-4acd-a58b-2b55667e9fc8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:51.847272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb7936-a873-4314-bc07-499b165a4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:51.848336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb7936-a873-4314-bc07-499b165a4eff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.848846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb7936-a873-4314-bc07-499b165a4eff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.849316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb7936-a873-4314-bc07-499b165a4eff None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.850541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb7936-a873-4314-bc07-499b165a4eff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:51.851086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb7936-a873-4314-bc07-499b165a4eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:51.853659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb7936-a873-4314-bc07-499b165a4eff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:51.872598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 185/351] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:51.874903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360718e-4a86-4027-9f91-51039ab2aceb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.875402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360718e-4a86-4027-9f91-51039ab2aceb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.875894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360718e-4a86-4027-9f91-51039ab2aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.885577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c23e3-a9c2-45ef-abc0-12d65a1303d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:51.886366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c23e3-a9c2-45ef-abc0-12d65a1303d7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.886679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c23e3-a9c2-45ef-abc0-12d65a1303d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.886935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c23e3-a9c2-45ef-abc0-12d65a1303d7 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.888670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c23e3-a9c2-45ef-abc0-12d65a1303d7 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:51.890136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c23e3-a9c2-45ef-abc0-12d65a1303d7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:51.891886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 167/352] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:51 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:51.893101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99eb3-4169-495f-b9ca-f87908b7d188 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.893355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99eb3-4169-495f-b9ca-f87908b7d188 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.893640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99eb3-4169-495f-b9ca-f87908b7d188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.904678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c360718e-4a86-4027-9f91-51039ab2aceb None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:51.907318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c360718e-4a86-4027-9f91-51039ab2aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:51.917043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-edc99eb3-4169-495f-b9ca-f87908b7d188 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:51.919183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-edc99eb3-4169-495f-b9ca-f87908b7d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:51.932620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.015657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 186/353] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:52.016927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360718e-4a86-4027-9f91-51039ab2aceb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.029677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 168/354] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:52.034960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc99eb3-4169-495f-b9ca-f87908b7d188 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.170684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.264596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360718e-4a86-4027-9f91-51039ab2aceb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.266396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc99eb3-4169-495f-b9ca-f87908b7d188 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.332208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989338a-7e4d-41e9-b4ba-cb7569019009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.333261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989338a-7e4d-41e9-b4ba-cb7569019009 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.333750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989338a-7e4d-41e9-b4ba-cb7569019009 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.334234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989338a-7e4d-41e9-b4ba-cb7569019009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.335773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493359b-01f2-4139-9e1e-e2db0c72eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.337232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493359b-01f2-4139-9e1e-e2db0c72eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.338091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493359b-01f2-4139-9e1e-e2db0c72eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.338896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493359b-01f2-4139-9e1e-e2db0c72eaa7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.362835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493359b-01f2-4139-9e1e-e2db0c72eaa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f493359b-01f2-4139-9e1e-e2db0c72eaa7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:52.374725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:52.377452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:52.380091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:52.381278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.383374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 169/355] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:52.385182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493359b-01f2-4139-9e1e-e2db0c72eaa7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.457105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989338a-7e4d-41e9-b4ba-cb7569019009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.461157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989338a-7e4d-41e9-b4ba-cb7569019009 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.557235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493359b-01f2-4139-9e1e-e2db0c72eaa7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.559468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.605166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29ab6e-8a64-4538-80cd-44db1b536553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.606224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ab6e-8a64-4538-80cd-44db1b536553 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.606734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ab6e-8a64-4538-80cd-44db1b536553 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.607223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29ab6e-8a64-4538-80cd-44db1b536553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.631656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 187/356] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:52.632534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989338a-7e4d-41e9-b4ba-cb7569019009 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.709835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.724787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29ab6e-8a64-4538-80cd-44db1b536553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.727273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29ab6e-8a64-4538-80cd-44db1b536553 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.781608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989338a-7e4d-41e9-b4ba-cb7569019009 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.848287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f64afe-df47-4e24-969c-0053975d6c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.849226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64afe-df47-4e24-969c-0053975d6c7d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.849593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64afe-df47-4e24-969c-0053975d6c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.850029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f64afe-df47-4e24-969c-0053975d6c7d None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.859515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f64afe-df47-4e24-969c-0053975d6c7d None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.861231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f64afe-df47-4e24-969c-0053975d6c7d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.864266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 188/357] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:52.864266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f64afe-df47-4e24-969c-0053975d6c7d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.878880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 170/358] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:52.879767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29ab6e-8a64-4538-80cd-44db1b536553 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.882480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.037859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29ab6e-8a64-4538-80cd-44db1b536553 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.064632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f64afe-df47-4e24-969c-0053975d6c7d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.085636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.099776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60652e0d-9ccd-4804-b3ef-3f01b47f6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.100772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60652e0d-9ccd-4804-b3ef-3f01b47f6e23 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.101255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60652e0d-9ccd-4804-b3ef-3f01b47f6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.101706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60652e0d-9ccd-4804-b3ef-3f01b47f6e23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.110837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5016-618c-45ff-9d44-1fd32a170ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.111910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5016-618c-45ff-9d44-1fd32a170ada None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.112239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5016-618c-45ff-9d44-1fd32a170ada None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.112556 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5016-618c-45ff-9d44-1fd32a170ada None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.122058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60652e0d-9ccd-4804-b3ef-3f01b47f6e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-60652e0d-9ccd-4804-b3ef-3f01b47f6e23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:53.127211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:53.128951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:53.130515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:53.131820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b5016-618c-45ff-9d44-1fd32a170ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:53.131951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 171/359] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:53.131951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60652e0d-9ccd-4804-b3ef-3f01b47f6e23 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5b2b5016-618c-45ff-9d44-1fd32a170ada None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:53.144219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:53.146545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 189/360] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:53.148789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5016-618c-45ff-9d44-1fd32a170ada None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.236820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.301754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60652e0d-9ccd-4804-b3ef-3f01b47f6e23 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.327583 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5016-618c-45ff-9d44-1fd32a170ada None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.350372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.350941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.351223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.351527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.352214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:53.352529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.353987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.365083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 172/361] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:53.366059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.398574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc466c-abf7-4e8e-8bd1-96d650dee588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.399280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc466c-abf7-4e8e-8bd1-96d650dee588 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.399543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc466c-abf7-4e8e-8bd1-96d650dee588 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.399824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc466c-abf7-4e8e-8bd1-96d650dee588 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.401463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc466c-abf7-4e8e-8bd1-96d650dee588 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.404433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc466c-abf7-4e8e-8bd1-96d650dee588 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.405653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 190/362] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:53.407991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc466c-abf7-4e8e-8bd1-96d650dee588 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.472037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.525841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5dd62-24ec-4383-a81a-86de279f8edb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.555018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.559241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc466c-abf7-4e8e-8bd1-96d650dee588 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.575934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.576835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.577125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.577409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.578167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] RBAC: Adding query filter params (group.id=c392398efa2341378f3d3e5ede62889e, role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=eac39512f21849eda95175d1d3af66de) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:53.578513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.580044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.586426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 173/363] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/role_assignments?group.id=c392398efa2341378f3d3e5ede62889e&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=af32346e85724870afa2c6aee5b285ed => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:53.587285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.621374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a2bf-81c5-4496-b9cc-4ef3b1feda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.622011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a2bf-81c5-4496-b9cc-4ef3b1feda18 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.622341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a2bf-81c5-4496-b9cc-4ef3b1feda18 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.622624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a2bf-81c5-4496-b9cc-4ef3b1feda18 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.623916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061a2bf-81c5-4496-b9cc-4ef3b1feda18 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.625452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061a2bf-81c5-4496-b9cc-4ef3b1feda18 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.634336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 191/364] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:53.634336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a2bf-81c5-4496-b9cc-4ef3b1feda18 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.769647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669465c-d317-429a-8d00-dad01757bdcf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.798436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a2bf-81c5-4496-b9cc-4ef3b1feda18 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.820082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.841785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.842517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.842806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.843084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.843791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:53.844098 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.845562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.862314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 174/365] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:53.862314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.865326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.866576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.867070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.867428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.868826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:53.869369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.872413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.893226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 192/366] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:53.893226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.959091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:54.052187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629485b6-fad2-43dc-afd6-3b5338778623 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:54.070232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffef96-4f9c-4447-8a1d-152f8a3e7e77 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:54.115349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a7bfd-f406-45d2-9fa0-9b78b3ca4b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:54.116389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a7bfd-f406-45d2-9fa0-9b78b3ca4b50 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.116875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a7bfd-f406-45d2-9fa0-9b78b3ca4b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.117359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a7bfd-f406-45d2-9fa0-9b78b3ca4b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.121231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456b3f-1a06-4307-9ad8-2129888cb309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:54.122046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456b3f-1a06-4307-9ad8-2129888cb309 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.122634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456b3f-1a06-4307-9ad8-2129888cb309 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.122980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456b3f-1a06-4307-9ad8-2129888cb309 None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.124527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456b3f-1a06-4307-9ad8-2129888cb309 None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:54.126555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456b3f-1a06-4307-9ad8-2129888cb309 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:54.134043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 193/367] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:54.134043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456b3f-1a06-4307-9ad8-2129888cb309 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:54.208972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:54.233608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a7bfd-f406-45d2-9fa0-9b78b3ca4b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:54.236540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a7bfd-f406-45d2-9fa0-9b78b3ca4b50 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:54.304711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456b3f-1a06-4307-9ad8-2129888cb309 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:54.321240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:54.351185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f3de-62a7-499b-bc36-8772019cd56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:54.351836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f3de-62a7-499b-bc36-8772019cd56c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.352114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f3de-62a7-499b-bc36-8772019cd56c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.352393 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f3de-62a7-499b-bc36-8772019cd56c None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.354251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f3de-62a7-499b-bc36-8772019cd56c None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:54.356904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f3de-62a7-499b-bc36-8772019cd56c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:54.366184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 194/368] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:54 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:54.366184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f3de-62a7-499b-bc36-8772019cd56c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:54.420592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 175/369] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:54.422053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a7bfd-f406-45d2-9fa0-9b78b3ca4b50 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:54.555713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f3de-62a7-499b-bc36-8772019cd56c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:54.556943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a7bfd-f406-45d2-9fa0-9b78b3ca4b50 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:54.575492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:54.615151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dd4fa-6f14-4977-9925-129fef698777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:54.616127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dd4fa-6f14-4977-9925-129fef698777 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.616311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73326a6b-01fa-4319-a2cf-cf5677419e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:54.616600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dd4fa-6f14-4977-9925-129fef698777 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.617018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dd4fa-6f14-4977-9925-129fef698777 None admin] PATH_INFO: `/v3/users/a36c6ef30a7f4498971f186af9fcb0f7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.617163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326a6b-01fa-4319-a2cf-cf5677419e34 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.617605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326a6b-01fa-4319-a2cf-cf5677419e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.618455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326a6b-01fa-4319-a2cf-cf5677419e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.619106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dd4fa-6f14-4977-9925-129fef698777 None admin] RBAC: Authorizing `identity:get_user(user_id=a36c6ef30a7f4498971f186af9fcb0f7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:54.621619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dd4fa-6f14-4977-9925-129fef698777 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:54.624232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 195/370] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:54 2022] GET /identity/v3/users/a36c6ef30a7f4498971f186af9fcb0f7 => generated 293 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:54.625586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dd4fa-6f14-4977-9925-129fef698777 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:54.658563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:54.739497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73326a6b-01fa-4319-a2cf-cf5677419e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:54.740850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73326a6b-01fa-4319-a2cf-cf5677419e34 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:54.793662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dd4fa-6f14-4977-9925-129fef698777 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:54.857808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:54.858896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.859386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.859869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.861165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] RBAC: Adding query filter params (group.id=c392398efa2341378f3d3e5ede62889e, role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:54.861672 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:54.864385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:54.886682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 196/371] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:54 2022] GET /identity/v3/role_assignments?group.id=c392398efa2341378f3d3e5ede62889e&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=af32346e85724870afa2c6aee5b285ed => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:54.886682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:54.898990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 176/372] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:54.900165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73326a6b-01fa-4319-a2cf-cf5677419e34 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:54.973359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:55.016634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:55.084612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592d42e-43ff-47d5-8c02-2bc5a7b330c2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.125398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73326a6b-01fa-4319-a2cf-cf5677419e34 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.146985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.148246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.148921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.149564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.151167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] RBAC: Adding query filter params (group.id=c392398efa2341378f3d3e5ede62889e, role.id=664110d895074b5a89855c373f794807, scope.project.id=eac39512f21849eda95175d1d3af66de) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:55.152486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:55.155365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:55.165968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 197/373] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:54 2022] GET /identity/v3/role_assignments?group.id=c392398efa2341378f3d3e5ede62889e&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=664110d895074b5a89855c373f794807 => generated 260 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:55.168153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.199325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12addbb9-eeb9-4502-b79f-1184915d2032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.201124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12addbb9-eeb9-4502-b79f-1184915d2032 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.201859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12addbb9-eeb9-4502-b79f-1184915d2032 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.202607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12addbb9-eeb9-4502-b79f-1184915d2032 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.205091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12addbb9-eeb9-4502-b79f-1184915d2032 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:55.208557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12addbb9-eeb9-4502-b79f-1184915d2032 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:55.212252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 177/374] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:54 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:55.215362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12addbb9-eeb9-4502-b79f-1184915d2032 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.453025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12addbb9-eeb9-4502-b79f-1184915d2032 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.492632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:55.512464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b19e46-a4ed-4e15-8ba2-d2e9f9b0c441 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.528606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:55.529050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74909079-f507-4bb1-9226-fd908c59e173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.530481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74909079-f507-4bb1-9226-fd908c59e173 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.531244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74909079-f507-4bb1-9226-fd908c59e173 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.531970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74909079-f507-4bb1-9226-fd908c59e173 None admin] PATH_INFO: `/v3/projects/41333422ff5e4255bb6c2174f444b692` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.534482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74909079-f507-4bb1-9226-fd908c59e173 None admin] RBAC: Authorizing `identity:get_project(project_id=41333422ff5e4255bb6c2174f444b692)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:55.537488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74909079-f507-4bb1-9226-fd908c59e173 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:55.546425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 178/375] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/projects/41333422ff5e4255bb6c2174f444b692 => generated 344 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:55.548418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74909079-f507-4bb1-9226-fd908c59e173 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.584394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.585629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.586201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.586787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.588189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] RBAC: Adding query filter params (role.id=17ed2a44e14a4da180fe4f88ed7568b3, user.id=a36c6ef30a7f4498971f186af9fcb0f7, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:55.588994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:55.592597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:55.620024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 198/376] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/role_assignments?user.id=a36c6ef30a7f4498971f186af9fcb0f7&scope.system=all&role.id=17ed2a44e14a4da180fe4f88ed7568b3 => generated 510 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:55.622615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.833501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74909079-f507-4bb1-9226-fd908c59e173 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.849580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01412a-dfc6-4cf0-9711-de81198efb4b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.907604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925459b4-d83f-4eea-809a-840a68ab6596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.907604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925459b4-d83f-4eea-809a-840a68ab6596 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.907604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925459b4-d83f-4eea-809a-840a68ab6596 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.907604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925459b4-d83f-4eea-809a-840a68ab6596 None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.909509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925459b4-d83f-4eea-809a-840a68ab6596 None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:55.913271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925459b4-d83f-4eea-809a-840a68ab6596 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:55.916742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 179/377] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:55.926448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925459b4-d83f-4eea-809a-840a68ab6596 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.992116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce19b7f-24dd-4c32-8470-7db9bfcc7b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.993789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce19b7f-24dd-4c32-8470-7db9bfcc7b1e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.994518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce19b7f-24dd-4c32-8470-7db9bfcc7b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.995231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce19b7f-24dd-4c32-8470-7db9bfcc7b1e None admin] PATH_INFO: `/v3/groups/474f5c93a2a0456eb728452fcf4c18a2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.011536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce19b7f-24dd-4c32-8470-7db9bfcc7b1e None admin] RBAC: Authorizing `identity:get_group(group_id=474f5c93a2a0456eb728452fcf4c18a2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:56.014551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce19b7f-24dd-4c32-8470-7db9bfcc7b1e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:56.017903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 199/378] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/groups/474f5c93a2a0456eb728452fcf4c18a2 => generated 229 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:56.029467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce19b7f-24dd-4c32-8470-7db9bfcc7b1e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:56.102730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:56.128518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:56.185204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925459b4-d83f-4eea-809a-840a68ab6596 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:56.273067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204e08-1a4b-4add-95a4-ec9e5164f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:56.274322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204e08-1a4b-4add-95a4-ec9e5164f38d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.274832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204e08-1a4b-4add-95a4-ec9e5164f38d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.275327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204e08-1a4b-4add-95a4-ec9e5164f38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.279022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25204e08-1a4b-4add-95a4-ec9e5164f38d None admin] RBAC: Adding query filter params (group.id=c392398efa2341378f3d3e5ede62889e, role.id=664110d895074b5a89855c373f794807, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:56.279022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25204e08-1a4b-4add-95a4-ec9e5164f38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:56.280944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25204e08-1a4b-4add-95a4-ec9e5164f38d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:56.295200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 180/379] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/role_assignments?group.id=c392398efa2341378f3d3e5ede62889e&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=664110d895074b5a89855c373f794807 => generated 260 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:56.338384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce19b7f-24dd-4c32-8470-7db9bfcc7b1e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:56.437007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d3da-135c-4fde-9114-60aebc5abfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:56.438173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d3da-135c-4fde-9114-60aebc5abfef None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.438820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d3da-135c-4fde-9114-60aebc5abfef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.439449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d3da-135c-4fde-9114-60aebc5abfef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.440832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888d3da-135c-4fde-9114-60aebc5abfef None admin] RBAC: Adding query filter params (group.id=474f5c93a2a0456eb728452fcf4c18a2, role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=41333422ff5e4255bb6c2174f444b692) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:56.441612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888d3da-135c-4fde-9114-60aebc5abfef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:56.444640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888d3da-135c-4fde-9114-60aebc5abfef None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:56.460248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 200/380] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:56 2022] GET /identity/v3/role_assignments?group.id=474f5c93a2a0456eb728452fcf4c18a2&scope.project.id=41333422ff5e4255bb6c2174f444b692&role.id=b76f0bbd02794923b10af161becac1c6 => generated 260 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:56.809638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36aef7-b07b-47fb-8f1b-4c49589afd1e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.809903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36aef7-b07b-47fb-8f1b-4c49589afd1e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.810328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36aef7-b07b-47fb-8f1b-4c49589afd1e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.811909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 181/381] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:56.820641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77f79-083b-46cb-a821-1af53a3348c8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.821567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77f79-083b-46cb-a821-1af53a3348c8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.822338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77f79-083b-46cb-a821-1af53a3348c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.863783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-61d77f79-083b-46cb-a821-1af53a3348c8 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:56.866923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-61d77f79-083b-46cb-a821-1af53a3348c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:57.016284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 201/382] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:57.807196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36aef7-b07b-47fb-8f1b-4c49589afd1e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.931161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36aef7-b07b-47fb-8f1b-4c49589afd1e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:57.958385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:57.985800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa7077-6b7d-467b-b5f7-41d291ae99e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:57.986907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa7077-6b7d-467b-b5f7-41d291ae99e4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.987408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa7077-6b7d-467b-b5f7-41d291ae99e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.987903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa7077-6b7d-467b-b5f7-41d291ae99e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.008278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa7077-6b7d-467b-b5f7-41d291ae99e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-06fa7077-6b7d-467b-b5f7-41d291ae99e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:58.017603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:58.019313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:58.020852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:58.025618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 182/383] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:58.028368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d77f79-083b-46cb-a821-1af53a3348c8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.054882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.142075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d77f79-083b-46cb-a821-1af53a3348c8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.182444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.183677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.183886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.184162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.184843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:58.185150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.187004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.208829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 202/384] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:58.215449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa7077-6b7d-467b-b5f7-41d291ae99e4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.373539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa7077-6b7d-467b-b5f7-41d291ae99e4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.423370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991ceb1-cb6f-4ea9-87b1-ad369558cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.423946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991ceb1-cb6f-4ea9-87b1-ad369558cf2d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.424233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991ceb1-cb6f-4ea9-87b1-ad369558cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.424509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991ceb1-cb6f-4ea9-87b1-ad369558cf2d None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.425666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991ceb1-cb6f-4ea9-87b1-ad369558cf2d None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.427161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991ceb1-cb6f-4ea9-87b1-ad369558cf2d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.429075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 183/385] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:58.434607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.547490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.560221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd298-191e-4f04-8a7d-ac9c150ddd60 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.560628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd298-191e-4f04-8a7d-ac9c150ddd60 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.560910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd298-191e-4f04-8a7d-ac9c150ddd60 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.563098 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 184/386] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:58.568375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20058043-191c-4d68-95ce-477bb79b829f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.571307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941098-0768-4b05-9dfb-26b7a743c89b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.571604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941098-0768-4b05-9dfb-26b7a743c89b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.571886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941098-0768-4b05-9dfb-26b7a743c89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.607443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0b941098-0768-4b05-9dfb-26b7a743c89b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:58.609039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0b941098-0768-4b05-9dfb-26b7a743c89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:58.636047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb937fa8-ab54-48f5-9203-545e6157a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.637259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb937fa8-ab54-48f5-9203-545e6157a0bc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.639027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb937fa8-ab54-48f5-9203-545e6157a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.639718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb937fa8-ab54-48f5-9203-545e6157a0bc None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.642008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb937fa8-ab54-48f5-9203-545e6157a0bc None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.646393 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb937fa8-ab54-48f5-9203-545e6157a0bc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.648379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 203/387] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:58.656980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb937fa8-ab54-48f5-9203-545e6157a0bc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.701806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.747811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 185/388] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:58.748930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae555d-d222-4d34-b7f8-a603b55349c9 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.749220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae555d-d222-4d34-b7f8-a603b55349c9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.749495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae555d-d222-4d34-b7f8-a603b55349c9 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.751676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 186/389] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:58.757524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e37316-ccae-4101-93df-2876b6faa239 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.758149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e37316-ccae-4101-93df-2876b6faa239 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.758692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e37316-ccae-4101-93df-2876b6faa239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.778312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a8e37316-ccae-4101-93df-2876b6faa239 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:58.779861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a8e37316-ccae-4101-93df-2876b6faa239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:58.804281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb937fa8-ab54-48f5-9203-545e6157a0bc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.856708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826da251-f5a5-4eda-b247-490ae99f83f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.857403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da251-f5a5-4eda-b247-490ae99f83f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.857687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da251-f5a5-4eda-b247-490ae99f83f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.857963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826da251-f5a5-4eda-b247-490ae99f83f4 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de/groups/c392398efa2341378f3d3e5ede62889e/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.859021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 187/390] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:58.860991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826da251-f5a5-4eda-b247-490ae99f83f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=eac39512f21849eda95175d1d3af66de, group_id=c392398efa2341378f3d3e5ede62889e, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.870896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826da251-f5a5-4eda-b247-490ae99f83f4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.893415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 204/391] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 08:01:58 2022] PUT /identity/v3/projects/eac39512f21849eda95175d1d3af66de/groups/c392398efa2341378f3d3e5ede62889e/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:59.079492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e37316-ccae-4101-93df-2876b6faa239 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.090583 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e44c-9169-4ea7-94a6-96c21c00bc77 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.091607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e44c-9169-4ea7-94a6-96c21c00bc77 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.092087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848e44c-9169-4ea7-94a6-96c21c00bc77 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.094085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 205/392] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:59.100001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c0932-65b2-4431-91a8-abf63423ad4f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.100628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c0932-65b2-4431-91a8-abf63423ad4f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.101115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c0932-65b2-4431-91a8-abf63423ad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.125182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c46c0932-65b2-4431-91a8-abf63423ad4f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:59.127141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c46c0932-65b2-4431-91a8-abf63423ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:59.145740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.204015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e37316-ccae-4101-93df-2876b6faa239 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.212180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.243958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 206/393] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:59.250974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59add31f-f674-437b-9008-e08822e80f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.250974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59add31f-f674-437b-9008-e08822e80f3e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.250974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59add31f-f674-437b-9008-e08822e80f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.250974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59add31f-f674-437b-9008-e08822e80f3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.266201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59add31f-f674-437b-9008-e08822e80f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-59add31f-f674-437b-9008-e08822e80f3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:59.271184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:59.272953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:59.275544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:59.278828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 188/394] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:59.280942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c0932-65b2-4431-91a8-abf63423ad4f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.306932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59add31f-f674-437b-9008-e08822e80f3e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.463701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59add31f-f674-437b-9008-e08822e80f3e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.478653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c0932-65b2-4431-91a8-abf63423ad4f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.517220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1be9b-8a7a-436c-9cb9-dd8419bd9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.518733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1be9b-8a7a-436c-9cb9-dd8419bd9a58 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.519569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1be9b-8a7a-436c-9cb9-dd8419bd9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.520077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1be9b-8a7a-436c-9cb9-dd8419bd9a58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.534190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1be9b-8a7a-436c-9cb9-dd8419bd9a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:59.535758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1b1d6-1ba9-4500-a330-bad0f15eb59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.536879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b1d6-1ba9-4500-a330-bad0f15eb59d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.537464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b1d6-1ba9-4500-a330-bad0f15eb59d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.538051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b1d6-1ba9-4500-a330-bad0f15eb59d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.539415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b1d6-1ba9-4500-a330-bad0f15eb59d None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:59.540058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b1d6-1ba9-4500-a330-bad0f15eb59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-44d1be9b-8a7a-436c-9cb9-dd8419bd9a58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:59.540673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:59.541570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:59.542955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:01:59.543735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b1d6-1ba9-4500-a330-bad0f15eb59d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.546293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 189/395] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:59.548464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91b667-fdd1-4133-b00f-955e28fa89df None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.548986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91b667-fdd1-4133-b00f-955e28fa89df None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.549441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91b667-fdd1-4133-b00f-955e28fa89df None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.551425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 190/396] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:59.553265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91b667-fdd1-4133-b00f-955e28fa89df None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.556999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 207/397] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:59.559665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69a34-45b3-4555-ae8c-3b060da67dc0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.560095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69a34-45b3-4555-ae8c-3b060da67dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.560451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69a34-45b3-4555-ae8c-3b060da67dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.572322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.594281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4ba69a34-45b3-4555-ae8c-3b060da67dc0 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:59.595713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4ba69a34-45b3-4555-ae8c-3b060da67dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:59.597657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.709511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 208/398] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:59.710515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69a34-45b3-4555-ae8c-3b060da67dc0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.717991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91b667-fdd1-4133-b00f-955e28fa89df None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.759716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.760439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.760789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.761167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.761852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:59.762158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.763596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.772541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 191/399] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:59.773413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.905839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69a34-45b3-4555-ae8c-3b060da67dc0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.935870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.959857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546eb0d7-4c79-43a1-85a5-4e82b697ac02 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.983726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bfa1c-8459-4a93-ab28-645f06e7b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.985222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bfa1c-8459-4a93-ab28-645f06e7b0dc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.985960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bfa1c-8459-4a93-ab28-645f06e7b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.986812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bfa1c-8459-4a93-ab28-645f06e7b0dc None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.989123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bfa1c-8459-4a93-ab28-645f06e7b0dc None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.992058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bfa1c-8459-4a93-ab28-645f06e7b0dc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.996647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 209/400] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:59.998503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bfa1c-8459-4a93-ab28-645f06e7b0dc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.005713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.024468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb5bd-208a-4417-ab5b-ce8bd1b742d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.025555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb5bd-208a-4417-ab5b-ce8bd1b742d5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.025981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb5bd-208a-4417-ab5b-ce8bd1b742d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.027064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb5bd-208a-4417-ab5b-ce8bd1b742d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.046551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cb5bd-208a-4417-ab5b-ce8bd1b742d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-594cb5bd-208a-4417-ab5b-ce8bd1b742d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:00.056002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:00.057707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:00.059354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 192/401] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:00.062112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb5bd-208a-4417-ab5b-ce8bd1b742d5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.167692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bfa1c-8459-4a93-ab28-645f06e7b0dc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.216939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58282ef-95c1-48a3-a0b0-fbe11d02ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.217598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58282ef-95c1-48a3-a0b0-fbe11d02ba0d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.217983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58282ef-95c1-48a3-a0b0-fbe11d02ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.218225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58282ef-95c1-48a3-a0b0-fbe11d02ba0d None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.219475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58282ef-95c1-48a3-a0b0-fbe11d02ba0d None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.220981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58282ef-95c1-48a3-a0b0-fbe11d02ba0d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.222909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 210/402] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:00.223589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58282ef-95c1-48a3-a0b0-fbe11d02ba0d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.229020 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb5bd-208a-4417-ab5b-ce8bd1b742d5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.297131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf0f41-810c-4a35-bb0d-a85b1cf02b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.297790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf0f41-810c-4a35-bb0d-a85b1cf02b55 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.298078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf0f41-810c-4a35-bb0d-a85b1cf02b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.298765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf0f41-810c-4a35-bb0d-a85b1cf02b55 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.300604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf0f41-810c-4a35-bb0d-a85b1cf02b55 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.302843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf0f41-810c-4a35-bb0d-a85b1cf02b55 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.305773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 193/403] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:00.307234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf0f41-810c-4a35-bb0d-a85b1cf02b55 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.338063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.360150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.431396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58282ef-95c1-48a3-a0b0-fbe11d02ba0d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.484409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf0f41-810c-4a35-bb0d-a85b1cf02b55 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.484758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca40bb-efc9-4f78-8789-466f86be380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.485401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca40bb-efc9-4f78-8789-466f86be380b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.485878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca40bb-efc9-4f78-8789-466f86be380b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.486399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca40bb-efc9-4f78-8789-466f86be380b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.505178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca40bb-efc9-4f78-8789-466f86be380b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-35ca40bb-efc9-4f78-8789-466f86be380b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:00.511222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:00.513218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 211/404] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:00.514760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca40bb-efc9-4f78-8789-466f86be380b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.561741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.562676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.563159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.563622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.564843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:00.565477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.568119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.590321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 194/405] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:00.590321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.690661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca40bb-efc9-4f78-8789-466f86be380b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.729069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.749191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.759928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf640df-4267-42d8-82bb-729c55dfaa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.761774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf640df-4267-42d8-82bb-729c55dfaa33 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.762205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290467e-0e54-469e-bcba-b49140e21996 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.762402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf640df-4267-42d8-82bb-729c55dfaa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.762923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf640df-4267-42d8-82bb-729c55dfaa33 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.765072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf640df-4267-42d8-82bb-729c55dfaa33 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.767797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf640df-4267-42d8-82bb-729c55dfaa33 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.775872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 212/406] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:00.775872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf640df-4267-42d8-82bb-729c55dfaa33 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.846403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3738c0-e57a-4b38-b973-38cd0137e950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.848444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3738c0-e57a-4b38-b973-38cd0137e950 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.848983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3738c0-e57a-4b38-b973-38cd0137e950 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.849485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3738c0-e57a-4b38-b973-38cd0137e950 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/groups/c392398efa2341378f3d3e5ede62889e/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.855802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3738c0-e57a-4b38-b973-38cd0137e950 None admin] RBAC: Authorizing `identity:create_grant(project_id=d802ed4ff9094e3d8e405ce3457077c6, group_id=c392398efa2341378f3d3e5ede62889e, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.859742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3738c0-e57a-4b38-b973-38cd0137e950 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.882206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 195/407] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 08:02:00 2022] PUT /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/groups/c392398efa2341378f3d3e5ede62889e/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:00.883475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3738c0-e57a-4b38-b973-38cd0137e950 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.972178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf640df-4267-42d8-82bb-729c55dfaa33 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.039287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.040850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.041667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.042526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.044013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:01.044796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.047582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.063140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 213/408] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:01.065058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.117216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3738c0-e57a-4b38-b973-38cd0137e950 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.185664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.192063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19363fd-4eac-4d64-9052-bad29eb6839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.193837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19363fd-4eac-4d64-9052-bad29eb6839a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.194375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19363fd-4eac-4d64-9052-bad29eb6839a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.194868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19363fd-4eac-4d64-9052-bad29eb6839a None admin] PATH_INFO: `/v3/groups/474f5c93a2a0456eb728452fcf4c18a2` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.197003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19363fd-4eac-4d64-9052-bad29eb6839a None admin] RBAC: Authorizing `identity:get_group(group_id=474f5c93a2a0456eb728452fcf4c18a2)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.200586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19363fd-4eac-4d64-9052-bad29eb6839a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.208242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 196/409] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/groups/474f5c93a2a0456eb728452fcf4c18a2 => generated 229 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:01.210038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19363fd-4eac-4d64-9052-bad29eb6839a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.232523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.285469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b3af6-7b81-4771-83d3-e0f4ba0d12e5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.358645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e78a3-1ea7-40f4-88c9-0f06b0fb1a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.359581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e78a3-1ea7-40f4-88c9-0f06b0fb1a9d None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.360190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e78a3-1ea7-40f4-88c9-0f06b0fb1a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.360481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e78a3-1ea7-40f4-88c9-0f06b0fb1a9d None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de/groups/c392398efa2341378f3d3e5ede62889e/roles/664110d895074b5a89855c373f794807` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.363892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e78a3-1ea7-40f4-88c9-0f06b0fb1a9d None admin] RBAC: Authorizing `identity:create_grant(project_id=eac39512f21849eda95175d1d3af66de, group_id=c392398efa2341378f3d3e5ede62889e, role_id=664110d895074b5a89855c373f794807)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.365368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e78a3-1ea7-40f4-88c9-0f06b0fb1a9d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.399333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 214/410] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 08:02:01 2022] PUT /identity/v3/projects/eac39512f21849eda95175d1d3af66de/groups/c392398efa2341378f3d3e5ede62889e/roles/664110d895074b5a89855c373f794807 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:01.400808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e78a3-1ea7-40f4-88c9-0f06b0fb1a9d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.468424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19363fd-4eac-4d64-9052-bad29eb6839a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.625950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e830cb-f327-4fbc-a044-05d03f7982d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.626690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e830cb-f327-4fbc-a044-05d03f7982d1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.626974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e830cb-f327-4fbc-a044-05d03f7982d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.627302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e830cb-f327-4fbc-a044-05d03f7982d1 None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.628520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e830cb-f327-4fbc-a044-05d03f7982d1 None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.630145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e830cb-f327-4fbc-a044-05d03f7982d1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.633220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 197/411] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:01.639783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e830cb-f327-4fbc-a044-05d03f7982d1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.659420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e78a3-1ea7-40f4-88c9-0f06b0fb1a9d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.707143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.739359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79cdf7-e6ec-4a30-935e-0f3506cbdeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.740794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79cdf7-e6ec-4a30-935e-0f3506cbdeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.741734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79cdf7-e6ec-4a30-935e-0f3506cbdeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.742564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79cdf7-e6ec-4a30-935e-0f3506cbdeb5 None admin] PATH_INFO: `/v3/projects/41333422ff5e4255bb6c2174f444b692` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.746061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79cdf7-e6ec-4a30-935e-0f3506cbdeb5 None admin] RBAC: Authorizing `identity:get_project(project_id=41333422ff5e4255bb6c2174f444b692)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.749972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79cdf7-e6ec-4a30-935e-0f3506cbdeb5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.754771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 215/412] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/projects/41333422ff5e4255bb6c2174f444b692 => generated 344 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:01.757265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440009b-cf46-497c-88eb-efcd818d7e33 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.757890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440009b-cf46-497c-88eb-efcd818d7e33 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.758523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440009b-cf46-497c-88eb-efcd818d7e33 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.762912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 216/413] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:01.764644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440009b-cf46-497c-88eb-efcd818d7e33 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.781830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.832471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e830cb-f327-4fbc-a044-05d03f7982d1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.898096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a710ab8-8cd6-4634-9b01-f4c5ad84a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.899220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710ab8-8cd6-4634-9b01-f4c5ad84a54f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.899714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710ab8-8cd6-4634-9b01-f4c5ad84a54f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.900206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a710ab8-8cd6-4634-9b01-f4c5ad84a54f None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.906288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a710ab8-8cd6-4634-9b01-f4c5ad84a54f None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.906288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a710ab8-8cd6-4634-9b01-f4c5ad84a54f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.908933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 198/414] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:01.911210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a862e6-f21a-465f-ba0c-d579df10c2a3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.911951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a862e6-f21a-465f-ba0c-d579df10c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.912131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a862e6-f21a-465f-ba0c-d579df10c2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.946691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440009b-cf46-497c-88eb-efcd818d7e33 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.955701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-50a862e6-f21a-465f-ba0c-d579df10c2a3 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:01.958766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-50a862e6-f21a-465f-ba0c-d579df10c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:01.993540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e2bf-34fe-4b23-850b-6f96c41d40d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.994713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e2bf-34fe-4b23-850b-6f96c41d40d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.995206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e2bf-34fe-4b23-850b-6f96c41d40d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.996280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e2bf-34fe-4b23-850b-6f96c41d40d7 None admin] PATH_INFO: `/v3/projects/41333422ff5e4255bb6c2174f444b692/groups/474f5c93a2a0456eb728452fcf4c18a2/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.998792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171e2bf-34fe-4b23-850b-6f96c41d40d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=41333422ff5e4255bb6c2174f444b692, group_id=474f5c93a2a0456eb728452fcf4c18a2, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:02.000663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171e2bf-34fe-4b23-850b-6f96c41d40d7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:02.023014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 217/415] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 08:02:01 2022] PUT /identity/v3/projects/41333422ff5e4255bb6c2174f444b692/groups/474f5c93a2a0456eb728452fcf4c18a2/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:02.024806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e2bf-34fe-4b23-850b-6f96c41d40d7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:02.098983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:02.108858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 199/416] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:02.241650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e2bf-34fe-4b23-850b-6f96c41d40d7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:02.324970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaafd3-7edb-43c6-a202-070f5d6fe29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:02.326176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaafd3-7edb-43c6-a202-070f5d6fe29f None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.326713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaafd3-7edb-43c6-a202-070f5d6fe29f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.327215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaafd3-7edb-43c6-a202-070f5d6fe29f None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/groups/c392398efa2341378f3d3e5ede62889e/roles/664110d895074b5a89855c373f794807` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.331185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaafd3-7edb-43c6-a202-070f5d6fe29f None admin] RBAC: Authorizing `identity:create_grant(project_id=d802ed4ff9094e3d8e405ce3457077c6, group_id=c392398efa2341378f3d3e5ede62889e, role_id=664110d895074b5a89855c373f794807)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:02.333911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaafd3-7edb-43c6-a202-070f5d6fe29f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:02.362039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 218/417] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 08:02:02 2022] PUT /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6/groups/c392398efa2341378f3d3e5ede62889e/roles/664110d895074b5a89855c373f794807 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:02.623125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a862e6-f21a-465f-ba0c-d579df10c2a3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:02.767618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:02.849064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a862e6-f21a-465f-ba0c-d579df10c2a3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:02.917068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fce28d-044b-4623-a56b-0ded17ba2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:02.918381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce28d-044b-4623-a56b-0ded17ba2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.924706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce28d-044b-4623-a56b-0ded17ba2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.925327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce28d-044b-4623-a56b-0ded17ba2ff3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.946053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fce28d-044b-4623-a56b-0ded17ba2ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-84fce28d-044b-4623-a56b-0ded17ba2ff3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:02.956283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:02.957250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:02:02.958145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:02.959267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 200/418] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:02.968140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaafd3-7edb-43c6-a202-070f5d6fe29f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaafd3-7edb-43c6-a202-070f5d6fe29f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:03.160979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:03.198121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:03.199364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.199722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.200000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.200701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:03.201010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:03.202457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:03.212199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 219/419] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:03.221991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fce28d-044b-4623-a56b-0ded17ba2ff3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.383660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fce28d-044b-4623-a56b-0ded17ba2ff3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:03.421328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:03.430757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bcb16-582c-49e8-9a44-2b8376df4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:03.431579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bcb16-582c-49e8-9a44-2b8376df4587 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.431867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bcb16-582c-49e8-9a44-2b8376df4587 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.432146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bcb16-582c-49e8-9a44-2b8376df4587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.550054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bcb16-582c-49e8-9a44-2b8376df4587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:03.551643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bcb16-582c-49e8-9a44-2b8376df4587 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:03.686993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 201/420] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:03.695175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.833265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb7b3-933b-4156-8f49-f5f6b6bff894 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:03.872571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354919e9-b0d1-4ae0-94a4-a202b69ca528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:03.873225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354919e9-b0d1-4ae0-94a4-a202b69ca528 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.873510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354919e9-b0d1-4ae0-94a4-a202b69ca528 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.873789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354919e9-b0d1-4ae0-94a4-a202b69ca528 None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.874992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354919e9-b0d1-4ae0-94a4-a202b69ca528 None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:03.876467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354919e9-b0d1-4ae0-94a4-a202b69ca528 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:03.878549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 220/421] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:03 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:03.887267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bcb16-582c-49e8-9a44-2b8376df4587 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.947538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:03.955745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9bbf-1b80-49a9-92bc-a09a56179d0f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.956356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9bbf-1b80-49a9-92bc-a09a56179d0f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.956863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b9bbf-1b80-49a9-92bc-a09a56179d0f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.958703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 221/422] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:03.965717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439658-cc45-4e3b-a4a8-5a1faeddb501 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.966747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439658-cc45-4e3b-a4a8-5a1faeddb501 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.967241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439658-cc45-4e3b-a4a8-5a1faeddb501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.002610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fe439658-cc45-4e3b-a4a8-5a1faeddb501 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:04.006581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fe439658-cc45-4e3b-a4a8-5a1faeddb501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:04.070903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bcb16-582c-49e8-9a44-2b8376df4587 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:04.071735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:04.110948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a5141-ff21-4982-80e0-90bcf6211940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:04.111515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5141-ff21-4982-80e0-90bcf6211940 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.111798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5141-ff21-4982-80e0-90bcf6211940 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.112084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5141-ff21-4982-80e0-90bcf6211940 None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.113293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a5141-ff21-4982-80e0-90bcf6211940 None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:04.114790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a5141-ff21-4982-80e0-90bcf6211940 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:04.116803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 202/423] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:02:03 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:04.118451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e67a-62ac-422e-8d2e-590304c7815b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.118746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e67a-62ac-422e-8d2e-590304c7815b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.119021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e67a-62ac-422e-8d2e-590304c7815b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.121269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 203/424] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:04.129928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e67a-62ac-422e-8d2e-590304c7815b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.164358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 222/425] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:02:04.166738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e730-4b3c-4da7-931f-42d5c2d6901e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.167269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e730-4b3c-4da7-931f-42d5c2d6901e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.167767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e730-4b3c-4da7-931f-42d5c2d6901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.203976 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2948e730-4b3c-4da7-931f-42d5c2d6901e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:04.206214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2948e730-4b3c-4da7-931f-42d5c2d6901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:04.347944 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 223/426] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:04.365946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:04.375781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e67a-62ac-422e-8d2e-590304c7815b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:04.456356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698af828-5602-4310-864c-50f86cc0230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:04.457480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698af828-5602-4310-864c-50f86cc0230b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.457981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698af828-5602-4310-864c-50f86cc0230b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.458545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698af828-5602-4310-864c-50f86cc0230b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.459983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698af828-5602-4310-864c-50f86cc0230b None admin] RBAC: Adding query filter params (group.id=c392398efa2341378f3d3e5ede62889e, role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=eac39512f21849eda95175d1d3af66de) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:04.460543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698af828-5602-4310-864c-50f86cc0230b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:04.463287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698af828-5602-4310-864c-50f86cc0230b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:04.481307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 204/427] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:02:04 2022] GET /identity/v3/role_assignments?group.id=c392398efa2341378f3d3e5ede62889e&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=af32346e85724870afa2c6aee5b285ed => generated 611 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:04.503408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948e730-4b3c-4da7-931f-42d5c2d6901e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.722901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:04.730440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948e730-4b3c-4da7-931f-42d5c2d6901e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:04.789209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698af828-5602-4310-864c-50f86cc0230b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.805636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fac439-ada8-44c6-9b94-c0be6e16e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:04.807348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fac439-ada8-44c6-9b94-c0be6e16e062 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.808337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fac439-ada8-44c6-9b94-c0be6e16e062 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.808925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fac439-ada8-44c6-9b94-c0be6e16e062 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.835053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fac439-ada8-44c6-9b94-c0be6e16e062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-15fac439-ada8-44c6-9b94-c0be6e16e062 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:04.846204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:04.847194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:02:04.848509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:04.849919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 224/428] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:04.858804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fac439-ada8-44c6-9b94-c0be6e16e062 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.952023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698af828-5602-4310-864c-50f86cc0230b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:04.992551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a61c1-25e0-487c-8c4b-75565c9f707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:04.993790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a61c1-25e0-487c-8c4b-75565c9f707f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.994324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a61c1-25e0-487c-8c4b-75565c9f707f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.994807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a61c1-25e0-487c-8c4b-75565c9f707f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.007741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a61c1-25e0-487c-8c4b-75565c9f707f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-1c6a61c1-25e0-487c-8c4b-75565c9f707f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:05.014653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:05.015705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:02:05.016512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:05.019500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 205/429] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:05.025625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a61c1-25e0-487c-8c4b-75565c9f707f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.065456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.086618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fac439-ada8-44c6-9b94-c0be6e16e062 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.157119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a61c1-25e0-487c-8c4b-75565c9f707f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.158349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.159416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.159947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.160559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.161700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:05.162230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.164980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.186313 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 225/430] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:05.191971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.206914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a51c0d-7a0c-477a-a592-021215099ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.207913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51c0d-7a0c-477a-a592-021215099ddf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.208683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51c0d-7a0c-477a-a592-021215099ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.209386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51c0d-7a0c-477a-a592-021215099ddf None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.210721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a51c0d-7a0c-477a-a592-021215099ddf None admin] RBAC: Adding query filter params (name=member) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:05.211255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a51c0d-7a0c-477a-a592-021215099ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.212867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a51c0d-7a0c-477a-a592-021215099ddf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.225546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 206/431] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:05.226926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc49c3b-3960-434e-bfd2-d7f2e418ea0a None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.227292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc49c3b-3960-434e-bfd2-d7f2e418ea0a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.227645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc49c3b-3960-434e-bfd2-d7f2e418ea0a None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.229090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 207/432] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:05.234555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc49c3b-3960-434e-bfd2-d7f2e418ea0a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.243684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.360992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df3f4-330b-40b4-9bcb-9a8a913172fa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.372939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.393632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc49c3b-3960-434e-bfd2-d7f2e418ea0a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.413401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7e20f-b44d-4b45-b758-9b9fd6098310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.414474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7e20f-b44d-4b45-b758-9b9fd6098310 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.415008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7e20f-b44d-4b45-b758-9b9fd6098310 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.415499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7e20f-b44d-4b45-b758-9b9fd6098310 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.435628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fb503-df2e-4b61-b55d-cacdae0ff544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.436407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fb503-df2e-4b61-b55d-cacdae0ff544 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.437643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fb503-df2e-4b61-b55d-cacdae0ff544 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.438104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fb503-df2e-4b61-b55d-cacdae0ff544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.517594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7e20f-b44d-4b45-b758-9b9fd6098310 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.518996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7e20f-b44d-4b45-b758-9b9fd6098310 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.521460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fb503-df2e-4b61-b55d-cacdae0ff544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.523161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fb503-df2e-4b61-b55d-cacdae0ff544 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.545543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.644279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.654157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 226/433] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:02:05.655093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c6cf-b9a8-4d35-a1b3-22df70923f9f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.655522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c6cf-b9a8-4d35-a1b3-22df70923f9f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.655715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c6cf-b9a8-4d35-a1b3-22df70923f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.665921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 208/434] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:05.672654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4c30d-5529-4da3-a7b4-efa7753e29ec None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.673105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4c30d-5529-4da3-a7b4-efa7753e29ec None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.673494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4c30d-5529-4da3-a7b4-efa7753e29ec None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.675613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 209/435] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:05.676862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4c30d-5529-4da3-a7b4-efa7753e29ec None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.681684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3db6c6cf-b9a8-4d35-a1b3-22df70923f9f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:05.683935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3db6c6cf-b9a8-4d35-a1b3-22df70923f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:05.773824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 227/436] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:05.775117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6c6cf-b9a8-4d35-a1b3-22df70923f9f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.830068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4c30d-5529-4da3-a7b4-efa7753e29ec None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.844096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.900305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954263f1-0b5f-4f41-97c4-65613a5dcbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.901397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954263f1-0b5f-4f41-97c4-65613a5dcbce None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.902518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954263f1-0b5f-4f41-97c4-65613a5dcbce None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.903001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954263f1-0b5f-4f41-97c4-65613a5dcbce None admin] PATH_INFO: `/v3/projects/eac39512f21849eda95175d1d3af66de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.905545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954263f1-0b5f-4f41-97c4-65613a5dcbce None admin] RBAC: Authorizing `identity:get_project(project_id=eac39512f21849eda95175d1d3af66de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.908231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954263f1-0b5f-4f41-97c4-65613a5dcbce None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.915821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 210/437] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/projects/eac39512f21849eda95175d1d3af66de => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:05.915821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e39f-4d1b-465b-b8aa-bde7a7e3c731 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.915821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e39f-4d1b-465b-b8aa-bde7a7e3c731 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.915821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e39f-4d1b-465b-b8aa-bde7a7e3c731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.945710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b8b4e39f-4d1b-465b-b8aa-bde7a7e3c731 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:05.947755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b8b4e39f-4d1b-465b-b8aa-bde7a7e3c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:05.951696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6c6cf-b9a8-4d35-a1b3-22df70923f9f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.016316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd669aa3-15f5-40b5-9059-6cd81e3863d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.017333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669aa3-15f5-40b5-9059-6cd81e3863d3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.017822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669aa3-15f5-40b5-9059-6cd81e3863d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.018369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669aa3-15f5-40b5-9059-6cd81e3863d3 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.019763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd669aa3-15f5-40b5-9059-6cd81e3863d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.021339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd669aa3-15f5-40b5-9059-6cd81e3863d3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.023147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 228/438] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.024012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd669aa3-15f5-40b5-9059-6cd81e3863d3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.037535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.061361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 211/439] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:06.062235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e39f-4d1b-465b-b8aa-bde7a7e3c731 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.192523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd669aa3-15f5-40b5-9059-6cd81e3863d3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.194644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e39f-4d1b-465b-b8aa-bde7a7e3c731 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.223829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.243225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea3a9-4be4-47aa-80f7-9fabb42bd5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.243969 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea3a9-4be4-47aa-80f7-9fabb42bd5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.244220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea3a9-4be4-47aa-80f7-9fabb42bd5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.244500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ea3a9-4be4-47aa-80f7-9fabb42bd5c6 None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.245724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ea3a9-4be4-47aa-80f7-9fabb42bd5c6 None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.247353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ea3a9-4be4-47aa-80f7-9fabb42bd5c6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.249899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f5f2-bcd5-4a6f-93ea-c67ddfb9a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.251345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f5f2-bcd5-4a6f-93ea-c67ddfb9a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.252682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f5f2-bcd5-4a6f-93ea-c67ddfb9a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.253107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f5f2-bcd5-4a6f-93ea-c67ddfb9a1c7 None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.253959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 212/440] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.255327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87f5f2-bcd5-4a6f-93ea-c67ddfb9a1c7 None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.255453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea3a9-4be4-47aa-80f7-9fabb42bd5c6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.257864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87f5f2-bcd5-4a6f-93ea-c67ddfb9a1c7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.266077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 229/441] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.266077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f5f2-bcd5-4a6f-93ea-c67ddfb9a1c7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.317552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.373280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ea3a9-4be4-47aa-80f7-9fabb42bd5c6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.412735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47423e-fb96-4ab5-8434-bf822b9576aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.413503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47423e-fb96-4ab5-8434-bf822b9576aa None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.413901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47423e-fb96-4ab5-8434-bf822b9576aa None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.414181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47423e-fb96-4ab5-8434-bf822b9576aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.424196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f5f2-bcd5-4a6f-93ea-c67ddfb9a1c7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.427350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47423e-fb96-4ab5-8434-bf822b9576aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-ff47423e-fb96-4ab5-8434-bf822b9576aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:06.432593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:06.435997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 213/442] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:06.437695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47423e-fb96-4ab5-8434-bf822b9576aa None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.478010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.478735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.479018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.479293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.481072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] RBAC: Adding query filter params (group.id=c392398efa2341378f3d3e5ede62889e, role.id=af32346e85724870afa2c6aee5b285ed, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:06.481072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.482572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.498304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 230/443] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/role_assignments?group.id=c392398efa2341378f3d3e5ede62889e&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=af32346e85724870afa2c6aee5b285ed => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.498304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.596698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.621638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47423e-fb96-4ab5-8434-bf822b9576aa None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.646454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.687311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.687943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.688228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.688517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.689261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] RBAC: Adding query filter params (group.id=c392398efa2341378f3d3e5ede62889e, role.id=664110d895074b5a89855c373f794807, scope.project.id=eac39512f21849eda95175d1d3af66de) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:06.690362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.691085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.702625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 214/444] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/role_assignments?group.id=c392398efa2341378f3d3e5ede62889e&scope.project.id=eac39512f21849eda95175d1d3af66de&role.id=664110d895074b5a89855c373f794807 => generated 611 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.702625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.706598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c1e5-ca34-46b7-8588-01a14dfac21d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.780118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.781324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.781897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.782509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.783858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:06.784459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.787057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.802388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 231/445] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.811315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.908459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9bc4a-bfaa-4451-a64d-8012111ab5dd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.960073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ca979-376a-4818-bee9-2af51c2358f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.960740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca979-376a-4818-bee9-2af51c2358f6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.961026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca979-376a-4818-bee9-2af51c2358f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.961302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca979-376a-4818-bee9-2af51c2358f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.975446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ca979-376a-4818-bee9-2af51c2358f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f24ca979-376a-4818-bee9-2af51c2358f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:06.981832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:06.985914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:06.987596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 215/446] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:06.988746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3d4e5-4f45-4653-84f8-aef59169bbf5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.989601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ca979-376a-4818-bee9-2af51c2358f6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.008779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.039997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6e37b-f4b9-46b1-9988-c758c4ecd180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.040627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6e37b-f4b9-46b1-9988-c758c4ecd180 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.040917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6e37b-f4b9-46b1-9988-c758c4ecd180 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.041191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6e37b-f4b9-46b1-9988-c758c4ecd180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.043096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.128427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6e37b-f4b9-46b1-9988-c758c4ecd180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.129932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6e37b-f4b9-46b1-9988-c758c4ecd180 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.144096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ca979-376a-4818-bee9-2af51c2358f6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.188156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.188762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.189054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.189703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.190452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:07.190765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.193130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.203773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 216/447] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:07.210174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.282952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 232/448] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:02:07.289326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6e37b-f4b9-46b1-9988-c758c4ecd180 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.312424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.366339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.373608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fbcf6-1a85-45cb-aa9c-89265097e975 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.420021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6e37b-f4b9-46b1-9988-c758c4ecd180 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.424111 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44104c59-8100-4851-8f11-9e84eaad90ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.425010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104c59-8100-4851-8f11-9e84eaad90ee None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.425458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104c59-8100-4851-8f11-9e84eaad90ee None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.425903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104c59-8100-4851-8f11-9e84eaad90ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.468034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f960-3782-4f9c-b936-4560b2ed6559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.468595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f960-3782-4f9c-b936-4560b2ed6559 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.468874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f960-3782-4f9c-b936-4560b2ed6559 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.469147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f960-3782-4f9c-b936-4560b2ed6559 None admin] PATH_INFO: `/v3/projects/41333422ff5e4255bb6c2174f444b692` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.470359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f960-3782-4f9c-b936-4560b2ed6559 None admin] RBAC: Authorizing `identity:get_project(project_id=41333422ff5e4255bb6c2174f444b692)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.471824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f960-3782-4f9c-b936-4560b2ed6559 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.473487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 233/449] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/projects/41333422ff5e4255bb6c2174f444b692 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:07.479398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f960-3782-4f9c-b936-4560b2ed6559 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.520206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44104c59-8100-4851-8f11-9e84eaad90ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.521910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44104c59-8100-4851-8f11-9e84eaad90ee None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.571192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.599400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f960-3782-4f9c-b936-4560b2ed6559 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.642497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.643203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80bc3f-cf61-4373-a487-fa5ce7d008f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.643866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bc3f-cf61-4373-a487-fa5ce7d008f4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.644522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bc3f-cf61-4373-a487-fa5ce7d008f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.644808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80bc3f-cf61-4373-a487-fa5ce7d008f4 None admin] PATH_INFO: `/v3/groups/474f5c93a2a0456eb728452fcf4c18a2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.646038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80bc3f-cf61-4373-a487-fa5ce7d008f4 None admin] RBAC: Authorizing `identity:get_group(group_id=474f5c93a2a0456eb728452fcf4c18a2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.647543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80bc3f-cf61-4373-a487-fa5ce7d008f4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.650060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 217/450] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:07.650249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 234/451] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/groups/474f5c93a2a0456eb728452fcf4c18a2 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:07.655212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44104c59-8100-4851-8f11-9e84eaad90ee None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.661038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80bc3f-cf61-4373-a487-fa5ce7d008f4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.769579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44104c59-8100-4851-8f11-9e84eaad90ee None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.781004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80bc3f-cf61-4373-a487-fa5ce7d008f4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.805530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.806131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.806448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.806718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.807446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] RBAC: Adding query filter params (group.id=474f5c93a2a0456eb728452fcf4c18a2, role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=41333422ff5e4255bb6c2174f444b692) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:07.807750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.809414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.815486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 218/452] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/role_assignments?group.id=474f5c93a2a0456eb728452fcf4c18a2&scope.project.id=41333422ff5e4255bb6c2174f444b692&role.id=b76f0bbd02794923b10af161becac1c6 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:07.817473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9713fe-a2ef-4751-9410-602a19994fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.818118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9713fe-a2ef-4751-9410-602a19994fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.818430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9713fe-a2ef-4751-9410-602a19994fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.818701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9713fe-a2ef-4751-9410-602a19994fa5 None admin] PATH_INFO: `/v3/projects/d802ed4ff9094e3d8e405ce3457077c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.819840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9713fe-a2ef-4751-9410-602a19994fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=d802ed4ff9094e3d8e405ce3457077c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.821300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9713fe-a2ef-4751-9410-602a19994fa5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.823093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 235/453] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/projects/d802ed4ff9094e3d8e405ce3457077c6 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:07.829471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.902696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.950075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896563a-9f44-4121-9922-997ac345ac11 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.989516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fc36d-0d98-45bc-9643-b77fc0ae9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.990187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fc36d-0d98-45bc-9643-b77fc0ae9d6b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.990480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fc36d-0d98-45bc-9643-b77fc0ae9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.990757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fc36d-0d98-45bc-9643-b77fc0ae9d6b None admin] PATH_INFO: `/v3/groups/c392398efa2341378f3d3e5ede62889e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.991962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fc36d-0d98-45bc-9643-b77fc0ae9d6b None admin] RBAC: Authorizing `identity:get_group(group_id=c392398efa2341378f3d3e5ede62889e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.993681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fc36d-0d98-45bc-9643-b77fc0ae9d6b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.995807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 219/454] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/groups/c392398efa2341378f3d3e5ede62889e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:08.002983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9713fe-a2ef-4751-9410-602a19994fa5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.023138 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:08.118979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9713fe-a2ef-4751-9410-602a19994fa5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.162580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36064734-733b-4323-990c-bf24bab300c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.163214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064734-733b-4323-990c-bf24bab300c1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.163500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064734-733b-4323-990c-bf24bab300c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.163775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064734-733b-4323-990c-bf24bab300c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.164526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36064734-733b-4323-990c-bf24bab300c1 None admin] RBAC: Adding query filter params (group.id=c392398efa2341378f3d3e5ede62889e, role.id=664110d895074b5a89855c373f794807, scope.project.id=d802ed4ff9094e3d8e405ce3457077c6) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:08.164844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36064734-733b-4323-990c-bf24bab300c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.166363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36064734-733b-4323-990c-bf24bab300c1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.179990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 236/455] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/role_assignments?group.id=c392398efa2341378f3d3e5ede62889e&scope.project.id=d802ed4ff9094e3d8e405ce3457077c6&role.id=664110d895074b5a89855c373f794807 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:11.069332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034633f-8834-4319-b024-3280a22ef55e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.070625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034633f-8834-4319-b024-3280a22ef55e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.071416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034633f-8834-4319-b024-3280a22ef55e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.074185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 220/456] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:11.081173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd33e8-e52d-4dc5-ae26-1b68515bf906 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.081995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd33e8-e52d-4dc5-ae26-1b68515bf906 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.081995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd33e8-e52d-4dc5-ae26-1b68515bf906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.112044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b9dd33e8-e52d-4dc5-ae26-1b68515bf906 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:11.113248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b9dd33e8-e52d-4dc5-ae26-1b68515bf906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:11.224301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 237/457] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:11.690827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00650b-c48b-4b5f-9089-74c6b75731c6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.691528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00650b-c48b-4b5f-9089-74c6b75731c6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.692027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00650b-c48b-4b5f-9089-74c6b75731c6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.693866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 221/458] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:11.701565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3fcc4-398f-4b8f-9ba5-207d80b44f80 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.702199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3fcc4-398f-4b8f-9ba5-207d80b44f80 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.702736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3fcc4-398f-4b8f-9ba5-207d80b44f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.731675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-89c3fcc4-398f-4b8f-9ba5-207d80b44f80 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:11.733263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-89c3fcc4-398f-4b8f-9ba5-207d80b44f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:11.737242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:11.815593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00650b-c48b-4b5f-9089-74c6b75731c6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:11.827296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 238/459] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:12.019724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa400-a9a8-41dc-91e2-9cd46b46b080 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.020043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa400-a9a8-41dc-91e2-9cd46b46b080 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.021066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa400-a9a8-41dc-91e2-9cd46b46b080 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.023695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 239/460] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:12.032426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333424d-eae3-49b7-b31e-ee161dd206f4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.033357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333424d-eae3-49b7-b31e-ee161dd206f4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.034091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333424d-eae3-49b7-b31e-ee161dd206f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.048895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00650b-c48b-4b5f-9089-74c6b75731c6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.086830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.094613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93011d5-1965-4158-a18a-3d5627e8a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.095516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93011d5-1965-4158-a18a-3d5627e8a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.095898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93011d5-1965-4158-a18a-3d5627e8a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.096279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93011d5-1965-4158-a18a-3d5627e8a6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.098319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6333424d-eae3-49b7-b31e-ee161dd206f4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:12.100054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6333424d-eae3-49b7-b31e-ee161dd206f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:12.122191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93011d5-1965-4158-a18a-3d5627e8a6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.123734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93011d5-1965-4158-a18a-3d5627e8a6e2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-f93011d5-1965-4158-a18a-3d5627e8a6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:12.154676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:12.156604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:12.158421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:12.158421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:12.158421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:12.160980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 222/461] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:12.163499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241b5ca-1d12-4686-9969-397302be0d2f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.164285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241b5ca-1d12-4686-9969-397302be0d2f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.165034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241b5ca-1d12-4686-9969-397302be0d2f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.174359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 223/462] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:12.176277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241b5ca-1d12-4686-9969-397302be0d2f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.217870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 240/463] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:12.224609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333424d-eae3-49b7-b31e-ee161dd206f4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.326689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.369606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241b5ca-1d12-4686-9969-397302be0d2f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.371027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333424d-eae3-49b7-b31e-ee161dd206f4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.429610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5a763-9247-4a00-af65-72bb88408f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.430638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a763-9247-4a00-af65-72bb88408f12 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.431084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a763-9247-4a00-af65-72bb88408f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.431511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a763-9247-4a00-af65-72bb88408f12 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.432330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5a763-9247-4a00-af65-72bb88408f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:12.432802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5a763-9247-4a00-af65-72bb88408f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.435063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5a763-9247-4a00-af65-72bb88408f12 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.445406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.447529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.448037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.449149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.459311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 224/464] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:12.461169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942dfd-e424-419a-833e-1a632d62f554 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.461682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942dfd-e424-419a-833e-1a632d62f554 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.462160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18942dfd-e424-419a-833e-1a632d62f554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.471587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.474785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.488835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-18942dfd-e424-419a-833e-1a632d62f554 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:12.490594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-18942dfd-e424-419a-833e-1a632d62f554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:12.509743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:12.511077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:12.512444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:12.512444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:12.512444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:12.513016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 241/465] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:12.514248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.536154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.576039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 225/466] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:12.577432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27df00-12f5-4b38-9637-26418c6fa027 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.577643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27df00-12f5-4b38-9637-26418c6fa027 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.577958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27df00-12f5-4b38-9637-26418c6fa027 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.579537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 226/467] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:12.581232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27df00-12f5-4b38-9637-26418c6fa027 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.671533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd796f-fe14-48df-a76e-344c6868e14e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.707009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.728213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92597b17-b5b0-4243-9672-7a9bcfa4312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.729112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92597b17-b5b0-4243-9672-7a9bcfa4312a None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.729627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92597b17-b5b0-4243-9672-7a9bcfa4312a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.731016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27df00-12f5-4b38-9637-26418c6fa027 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.731173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92597b17-b5b0-4243-9672-7a9bcfa4312a None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.731879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92597b17-b5b0-4243-9672-7a9bcfa4312a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.734941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92597b17-b5b0-4243-9672-7a9bcfa4312a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.774661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 242/468] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:02:12 2022] POST /identity/v3/users => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:12.774661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92597b17-b5b0-4243-9672-7a9bcfa4312a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.789516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c10334-4802-45f5-be91-0468f07adcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.790471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10334-4802-45f5-be91-0468f07adcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.790932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10334-4802-45f5-be91-0468f07adcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.791471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10334-4802-45f5-be91-0468f07adcb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.794378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c10334-4802-45f5-be91-0468f07adcb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:12.795087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c10334-4802-45f5-be91-0468f07adcb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.797103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c10334-4802-45f5-be91-0468f07adcb3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.817797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 227/469] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:12.820922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da889-dda9-4d46-9c88-1a3e1cdbc2d6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.821960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da889-dda9-4d46-9c88-1a3e1cdbc2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.822856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da889-dda9-4d46-9c88-1a3e1cdbc2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.857176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1f8da889-dda9-4d46-9c88-1a3e1cdbc2d6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:12.859769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1f8da889-dda9-4d46-9c88-1a3e1cdbc2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:12.913811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.984778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92597b17-b5b0-4243-9672-7a9bcfa4312a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.002082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 228/470] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:13.003055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8da889-dda9-4d46-9c88-1a3e1cdbc2d6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.040077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.040925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.041352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.041633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.057981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.061023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:13.097569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:13.101520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:13.104312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:13.104312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:13.104312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:13.104312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 243/471] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:13.115715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.169568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8da889-dda9-4d46-9c88-1a3e1cdbc2d6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.193846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:13.239582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e316d-1548-4020-a736-6aa1344e75ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.240607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e316d-1548-4020-a736-6aa1344e75ec None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.241093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e316d-1548-4020-a736-6aa1344e75ec None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.241556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e316d-1548-4020-a736-6aa1344e75ec None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.242875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e316d-1548-4020-a736-6aa1344e75ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.246586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e316d-1548-4020-a736-6aa1344e75ec None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.297696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 229/472] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:02:13 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:13.297696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e316d-1548-4020-a736-6aa1344e75ec None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.390550 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:13.423641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d5a33-ba2d-46a2-8482-76d7d5c2a43c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.533083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.534741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.535479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.537314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.541691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:13.541691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.541691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.554882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 244/473] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:13.556013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.606669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e316d-1548-4020-a736-6aa1344e75ec None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.656736 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.658058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.658058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.658058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.672516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.674306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:13.694298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:13.696004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:13.697602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:13.697602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:13.697602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:13.697602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 230/474] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:13.697602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.733887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:13.758016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab662b3-268f-4342-af18-9bfcb68fde24 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.811875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:13.846591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.848256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.849116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.849619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.850913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.851085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5df03-fdd2-480e-95ff-4468ea091e72 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.854420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.871512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.sql.core [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 08:02:13.871512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 08:02:13.871512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [parameters: {'id': '107ec2afd03b4212bf1e66ee8b255ebe', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 08:02:13.871512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 08:02:13.897550 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097dfa0-9007-493f-befc-1ddacd613308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.898352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097dfa0-9007-493f-befc-1ddacd613308 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.898732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097dfa0-9007-493f-befc-1ddacd613308 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.899101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097dfa0-9007-493f-befc-1ddacd613308 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.899857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097dfa0-9007-493f-befc-1ddacd613308 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.901473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097dfa0-9007-493f-befc-1ddacd613308 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 01 08:02:13.911891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:02:13.913861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application yield resource Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise self.value Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application session.commit() Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 08:02:13.916951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.flush() Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application compat.raise_( Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 08:02:13.926587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:02:13.927565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:02:13.928443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [parameters: {'id': '107ec2afd03b4212bf1e66ee8b255ebe', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:13.929225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 08:02:13.930045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:13.931002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 245/475] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 08:02:13 2022] POST /identity/v3/roles => generated 144 bytes in 359 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:13.931002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.950986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 231/476] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:02:13 2022] POST /identity/v3/users => generated 249 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:13.953832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097dfa0-9007-493f-befc-1ddacd613308 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.171902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097dfa0-9007-493f-befc-1ddacd613308 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.187104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aef104-d308-4ab0-bafa-fbaf0a95a116 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.222180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d47e34-faf8-4be2-985d-3605a86211b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.225344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47e34-faf8-4be2-985d-3605a86211b6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.225651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47e34-faf8-4be2-985d-3605a86211b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.225934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47e34-faf8-4be2-985d-3605a86211b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.230984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:14.241669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.242861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.243708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.243937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d47e34-faf8-4be2-985d-3605a86211b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:14.244470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.245382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:14.246464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:14.248129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-c6d47e34-faf8-4be2-985d-3605a86211b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:14.251566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:14.252490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:14.253695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 232/477] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:14.259347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d47e34-faf8-4be2-985d-3605a86211b6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.278855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 246/478] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:14.283042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.316928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:14.449284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d47e34-faf8-4be2-985d-3605a86211b6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.451558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae6d52-5d69-45f9-a214-44d0c5a351ed None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.487735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844b55f-265a-44a4-9e1c-0dc631fca59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.488360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b55f-265a-44a4-9e1c-0dc631fca59d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.488647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b55f-265a-44a4-9e1c-0dc631fca59d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.488928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b55f-265a-44a4-9e1c-0dc631fca59d None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.489614 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844b55f-265a-44a4-9e1c-0dc631fca59d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:14.489995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844b55f-265a-44a4-9e1c-0dc631fca59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:14.491386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f372af-a4e2-4d30-a318-9052358471cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.491608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844b55f-265a-44a4-9e1c-0dc631fca59d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:14.492420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f372af-a4e2-4d30-a318-9052358471cb None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.492920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f372af-a4e2-4d30-a318-9052358471cb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.493642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f372af-a4e2-4d30-a318-9052358471cb None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.494525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f372af-a4e2-4d30-a318-9052358471cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:14.498522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f372af-a4e2-4d30-a318-9052358471cb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:14.506542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 233/479] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:14.525487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 247/480] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:02:14 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:15.192393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16b5-df93-46ee-bfec-0ccfb8c6efef None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.192914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16b5-df93-46ee-bfec-0ccfb8c6efef None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.193024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16b5-df93-46ee-bfec-0ccfb8c6efef None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.194625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 234/481] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:15.200990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cd0f5-ef36-49d9-9a96-ad63c599ac62 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.201490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cd0f5-ef36-49d9-9a96-ad63c599ac62 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.201563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cd0f5-ef36-49d9-9a96-ad63c599ac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.228040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5e9cd0f5-ef36-49d9-9a96-ad63c599ac62 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:15.229259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5e9cd0f5-ef36-49d9-9a96-ad63c599ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:15.325871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:15.332521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 248/482] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:15.831586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b16b5-df93-46ee-bfec-0ccfb8c6efef None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:15.898999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:15.973575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b16b5-df93-46ee-bfec-0ccfb8c6efef None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.029304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6c51a-b029-4da0-aabb-00c9f728c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.030286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c51a-b029-4da0-aabb-00c9f728c7fe None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.030824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c51a-b029-4da0-aabb-00c9f728c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.031264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c51a-b029-4da0-aabb-00c9f728c7fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.051613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6c51a-b029-4da0-aabb-00c9f728c7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d4e6c51a-b029-4da0-aabb-00c9f728c7fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:16.056891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:16.058178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:16.059208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:16.061650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 235/483] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:16.067259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cd0f5-ef36-49d9-9a96-ad63c599ac62 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.085448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850dab-5554-4741-9317-6f54ee12082c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.085730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850dab-5554-4741-9317-6f54ee12082c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.085908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850dab-5554-4741-9317-6f54ee12082c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.088262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 236/484] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:16.095331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c0df-d9bd-405e-bd64-088410f70bfc None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.095909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c0df-d9bd-405e-bd64-088410f70bfc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.096192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c0df-d9bd-405e-bd64-088410f70bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.119911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-76f3c0df-d9bd-405e-bd64-088410f70bfc None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:16.121655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-76f3c0df-d9bd-405e-bd64-088410f70bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:16.212507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 237/485] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:02:16.301657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cd0f5-ef36-49d9-9a96-ad63c599ac62 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.352251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.352791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.353069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.353343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.354016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:16.354346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:16.362767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:16.372969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 249/486] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:16.378197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3c0df-d9bd-405e-bd64-088410f70bfc None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.460334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:16.561069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3c0df-d9bd-405e-bd64-088410f70bfc None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.612209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.612835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.613121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.613390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.634361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:16.635906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:16.654464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:16.655450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:16.656298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:16.656298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:16.656298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:16.656873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 238/487] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:16.662188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.691942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.865990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:16.890492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:16.901116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46d835-a8d3-4825-8111-0256520bac18 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.941147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57e032-bc32-4e52-9e65-ae390873fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.941798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57e032-bc32-4e52-9e65-ae390873fe0a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.942084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57e032-bc32-4e52-9e65-ae390873fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.942409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57e032-bc32-4e52-9e65-ae390873fe0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.950537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958b1d-34d1-4953-b86f-ae5257ff926f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.955329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57e032-bc32-4e52-9e65-ae390873fe0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-4d57e032-bc32-4e52-9e65-ae390873fe0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:16.960795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:16.961732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:16.962597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 239/488] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:16.963753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b184-97cc-4ddf-a4cc-02d8a0223ab6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.963848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b184-97cc-4ddf-a4cc-02d8a0223ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.966297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b184-97cc-4ddf-a4cc-02d8a0223ab6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.970076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 240/489] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:16.971068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b184-97cc-4ddf-a4cc-02d8a0223ab6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.017506 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d45215-a013-4c57-b83c-802305ce6858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.018581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d45215-a013-4c57-b83c-802305ce6858 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.018998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d45215-a013-4c57-b83c-802305ce6858 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.019387 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d45215-a013-4c57-b83c-802305ce6858 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.020334 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d45215-a013-4c57-b83c-802305ce6858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:17.020771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d45215-a013-4c57-b83c-802305ce6858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.022866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d45215-a013-4c57-b83c-802305ce6858 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.045046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 250/490] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:17.047345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20558b5a-b14a-48c3-87d1-37ea4c5000d1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.047783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20558b5a-b14a-48c3-87d1-37ea4c5000d1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.048212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20558b5a-b14a-48c3-87d1-37ea4c5000d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.079894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-20558b5a-b14a-48c3-87d1-37ea4c5000d1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:17.081980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-20558b5a-b14a-48c3-87d1-37ea4c5000d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:17.093405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b184-97cc-4ddf-a4cc-02d8a0223ab6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.150362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.151265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.152281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.152730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.153935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:17.154503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.157100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.172481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 241/491] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:17.174395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.193487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 251/492] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:17.195878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507dfc-b128-4675-b13f-4f80bbf58a46 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.196368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507dfc-b128-4675-b13f-4f80bbf58a46 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.196847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507dfc-b128-4675-b13f-4f80bbf58a46 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.197843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.200740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 252/493] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:17.202943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a507dfc-b128-4675-b13f-4f80bbf58a46 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.327451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.378709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7b2e-ff7f-45b3-9e28-8fc8e536aaae None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.423009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a507dfc-b128-4675-b13f-4f80bbf58a46 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.444353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1b651-d4e3-4918-80b8-7ccc46abcf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.445937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1b651-d4e3-4918-80b8-7ccc46abcf61 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.446783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1b651-d4e3-4918-80b8-7ccc46abcf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.447268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1b651-d4e3-4918-80b8-7ccc46abcf61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.462064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1b651-d4e3-4918-80b8-7ccc46abcf61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.465439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1b651-d4e3-4918-80b8-7ccc46abcf61 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.491700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0150-f9e7-469e-b9c6-7474b3f022e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.492747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0150-f9e7-469e-b9c6-7474b3f022e9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.493508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0150-f9e7-469e-b9c6-7474b3f022e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.493973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0150-f9e7-469e-b9c6-7474b3f022e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3bb1b651-d4e3-4918-80b8-7ccc46abcf61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:17.494445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:17.495415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:17.496339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:17.503795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 242/494] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:17.505911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e13e-67a3-4316-bf74-f4df2b5f2af4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.506427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e13e-67a3-4316-bf74-f4df2b5f2af4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.506919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e13e-67a3-4316-bf74-f4df2b5f2af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.514389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c0150-f9e7-469e-b9c6-7474b3f022e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.517255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c0150-f9e7-469e-b9c6-7474b3f022e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.532383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5da2e13e-67a3-4316-bf74-f4df2b5f2af4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:17.533612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5da2e13e-67a3-4316-bf74-f4df2b5f2af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c06c0150-f9e7-469e-b9c6-7474b3f022e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:17.550750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:17.552739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:17.554427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:17.554427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:17.554427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:17.554427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 253/495] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:17.555241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78b77-26f2-49bd-846d-c193f23005dc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.555453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78b77-26f2-49bd-846d-c193f23005dc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.556437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78b77-26f2-49bd-846d-c193f23005dc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.559844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 254/496] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:17.562294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d78b77-26f2-49bd-846d-c193f23005dc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.646191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 243/497] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:17.647148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2e13e-67a3-4316-bf74-f4df2b5f2af4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.649797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.735913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d78b77-26f2-49bd-846d-c193f23005dc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.740116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.783548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3b576-b63a-4b94-b5e4-e622ad3f1137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.784166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b576-b63a-4b94-b5e4-e622ad3f1137 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.784451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b576-b63a-4b94-b5e4-e622ad3f1137 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.784727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b576-b63a-4b94-b5e4-e622ad3f1137 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.785475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3b576-b63a-4b94-b5e4-e622ad3f1137 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:17.785907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3b576-b63a-4b94-b5e4-e622ad3f1137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.787428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3b576-b63a-4b94-b5e4-e622ad3f1137 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.809115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2e13e-67a3-4316-bf74-f4df2b5f2af4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.837047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 255/498] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:17.838507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c2e4-f7e0-4f94-a743-2c6534b937bb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.838913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c2e4-f7e0-4f94-a743-2c6534b937bb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.839790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c2e4-f7e0-4f94-a743-2c6534b937bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.861178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b468c2e4-f7e0-4f94-a743-2c6534b937bb None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:17.862560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b468c2e4-f7e0-4f94-a743-2c6534b937bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:17.879784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.880749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.881197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.881653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.882813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:17.883346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.885589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.908397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 244/499] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:17.910483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.985292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 256/500] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:17.986303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468c2e4-f7e0-4f94-a743-2c6534b937bb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.001305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.056329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58901b4-22f5-4262-99f4-993e63656c1e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.100105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd7342-92af-4c05-a8fc-e68f94d5e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.100858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd7342-92af-4c05-a8fc-e68f94d5e840 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.101215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd7342-92af-4c05-a8fc-e68f94d5e840 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.101568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd7342-92af-4c05-a8fc-e68f94d5e840 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.103060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.114629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd7342-92af-4c05-a8fc-e68f94d5e840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:18.114886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468c2e4-f7e0-4f94-a743-2c6534b937bb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-cedd7342-92af-4c05-a8fc-e68f94d5e840 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:18.120548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:18.121723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:18.122855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:18.124258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 245/501] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:18.124930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd7342-92af-4c05-a8fc-e68f94d5e840 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.161442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc286be1-01f2-4144-93d9-086eee753d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.162053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc286be1-01f2-4144-93d9-086eee753d39 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.162375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc286be1-01f2-4144-93d9-086eee753d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.162654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc286be1-01f2-4144-93d9-086eee753d39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.235251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd7342-92af-4c05-a8fc-e68f94d5e840 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.258791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc286be1-01f2-4144-93d9-086eee753d39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.259818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.262128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc286be1-01f2-4144-93d9-086eee753d39 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.276012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.276692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.277503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.277786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.286068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.287574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:18.300089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:18.306181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 246/502] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:18.307335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.400562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.413381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 257/503] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:18.414251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc286be1-01f2-4144-93d9-086eee753d39 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.434854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f879e-d26b-4ecd-a806-ec0845af39f8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.484743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0bffd-2238-4d00-b6df-c7ee7abca5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.485793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0bffd-2238-4d00-b6df-c7ee7abca5ac None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.486302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0bffd-2238-4d00-b6df-c7ee7abca5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.486769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0bffd-2238-4d00-b6df-c7ee7abca5ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.506588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0bffd-2238-4d00-b6df-c7ee7abca5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-90a0bffd-2238-4d00-b6df-c7ee7abca5ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:18.517726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:18.518960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:18.520376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 247/504] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:18.521645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0bffd-2238-4d00-b6df-c7ee7abca5ac None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.537824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc286be1-01f2-4144-93d9-086eee753d39 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.576679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.577369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.577713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.578051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.578839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:18.579217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.581002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.596367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 258/505] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:18.597273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.604216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.666130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.693412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0bffd-2238-4d00-b6df-c7ee7abca5ac None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.722148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff04b73-c7e8-4609-b1ac-fc044eba35c4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.742091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.742885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.743443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.743722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.756773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.758516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.768905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.769432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.769716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.770003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.770803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:18.771115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.772610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:18.778177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:18.782839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:18.783688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:18.783688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:18.783688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:18.783688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 248/506] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:18.783688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.805778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 259/507] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:18.805778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.896981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.905627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208799-2d07-499c-b329-9b54d76faf31 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.928231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b332-baa7-4038-a0fc-48e481870859 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.943706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.943929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.944268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.944549 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.944857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.957231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.958757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.970931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.971553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.971831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.972113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.972775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:18.973083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:18.974186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:18.975565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:18.976955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:18.976955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:18.976955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:18.977122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.977191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 249/508] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:18.977191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.990251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 260/509] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:18.995299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.083005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e43ab-524d-437a-8a22-5a42cc37cab1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.113450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c84a36-8a76-4f46-ae1f-456d0ad90210 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.119167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.119807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.120087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.120380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.132291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.133779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.141943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:19.153734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:19.155003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:19.156112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:19.156112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:19.156112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:19.160018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 250/510] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:19.160248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.160870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.161011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.161343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.161873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.162667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:19.163033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.164727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.184054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 261/511] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:19.185091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.227143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.295546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af815b-5078-47a8-b035-496735ef4918 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.306034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989e983-a63a-412f-b4d5-3e242123d634 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.342921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.343452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.343730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.344001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.344668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:19.344966 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.346406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.352106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6073aa-6a69-4f35-a589-349ccdd35072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.353119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6073aa-6a69-4f35-a589-349ccdd35072 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.353627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6073aa-6a69-4f35-a589-349ccdd35072 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.354094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6073aa-6a69-4f35-a589-349ccdd35072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.363799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 262/512] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:19.363799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.459195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.462971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6073aa-6a69-4f35-a589-349ccdd35072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.465368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6073aa-6a69-4f35-a589-349ccdd35072 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.475874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.485901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9d678-5dbd-4821-875d-fea9a495d313 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.531269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.532032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.532413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.532839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.545813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.547575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:19.565139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:19.567145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:19.568974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:19.568974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:19.568974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:19.568974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 263/513] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:19.568974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.602324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 251/514] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:19.603603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6073aa-6a69-4f35-a589-349ccdd35072 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.697574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af77c-970d-4723-9acc-25296f10906e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.728450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.734700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.735320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.735597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.735867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.736137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6073aa-6a69-4f35-a589-349ccdd35072 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.736520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:19.736986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.738474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.754176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 264/515] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:19.755333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.765702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.785547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b89a4-b00c-4cd7-aefc-961899569d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.786177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b89a4-b00c-4cd7-aefc-961899569d38 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.786529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b89a4-b00c-4cd7-aefc-961899569d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.786783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b89a4-b00c-4cd7-aefc-961899569d38 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.787471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b89a4-b00c-4cd7-aefc-961899569d38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.788961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b89a4-b00c-4cd7-aefc-961899569d38 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.812630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 252/516] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:02:19 2022] POST /identity/v3/users => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:19.812630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b89a4-b00c-4cd7-aefc-961899569d38 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.903951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38f2c-1c3f-42fa-b5fb-08902084d1ee None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.952388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.953217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.953549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.953968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.963599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b89a4-b00c-4cd7-aefc-961899569d38 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.964528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.967415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:19.988960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:19.990651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 265/517] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:19.992247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.015793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.016839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.017322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.017804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.019679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:20.020206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.022812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.046914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 253/518] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:20.049650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.078017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.089351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.149094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bc7f1-d304-4f46-9747-2198aa617d08 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.207269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.208228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.208700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.209170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.226041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d85c-cd0f-4c0c-ab11-e853e79e0233 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.227858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.230841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:20.256492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:20.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:20.260441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:20.260441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:20.260441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:20.266281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 266/519] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:20.267589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.291542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.293110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.293602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.294044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.306807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.309064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:20.330680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:20.331668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:20.332587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 254/520] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:20.333809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.463863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5a642-3ea8-436f-8838-e4802db4b77d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.485222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.504325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.518999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62adb-2bd6-4d38-9cae-4fb80b51e57f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.543564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.545392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.546090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.546633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.547939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:20.548666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.551341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.560644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.561280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.561550 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.561821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.570965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.572433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.583947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 267/521] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:20.585855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:20.587269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 255/522] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:20.589043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.592053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.733386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2a66a-e09d-49b9-bdf5-dfa6d72e6dcf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.775064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.775675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.775952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.776229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.777582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:20.777885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.778673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f1fb-dab8-4d25-8ab4-3738011675c3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.779390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.782064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.842643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.843621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.844098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.844563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.845782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:20.846344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.848953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.853229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 256/523] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:20.854623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.874304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 268/524] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:20.874304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.942818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.038733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0389fe-3a5c-42fc-9517-c83f19df2149 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.053180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c8f61-c944-4820-aec3-f449509a0d4f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.101302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.102210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.102659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.103080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.104643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=7949d9285d4e4c908c377a0ac16dd14d) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:21.105251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.108360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.114041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.115153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.115657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.116142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.117478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:21.118031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.120824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 257/525] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/role_assignments?user.id=7949d9285d4e4c908c377a0ac16dd14d&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:21.121102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.122825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.161851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 269/526] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:21.163159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.250703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.313610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.321174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a2c57-3ee2-46a1-9b97-76d7a4fb448e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.338315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b085b0a-d392-49b3-a8db-a8344db0947d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.365921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.366750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.367134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.367762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.383776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.385733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:21.402347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:21.403279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:21.404123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 270/527] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:21.404760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.415191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969bd20-3c88-4811-ad55-41762a254e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.416256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969bd20-3c88-4811-ad55-41762a254e62 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.416731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969bd20-3c88-4811-ad55-41762a254e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.417263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969bd20-3c88-4811-ad55-41762a254e62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.540361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969bd20-3c88-4811-ad55-41762a254e62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.543332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969bd20-3c88-4811-ad55-41762a254e62 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.576008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f31a4-14f5-4709-af6a-8e4b3c7d0cbf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.632423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.647127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb7ef-1653-463d-b487-afeac84159cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.647858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb7ef-1653-463d-b487-afeac84159cf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.648209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb7ef-1653-463d-b487-afeac84159cf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.648549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb7ef-1653-463d-b487-afeac84159cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.695193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.746179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 258/528] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:21.748752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969bd20-3c88-4811-ad55-41762a254e62 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.763019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edb7ef-1653-463d-b487-afeac84159cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.764797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edb7ef-1653-463d-b487-afeac84159cf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.879225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 271/529] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:21.884698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb7ef-1653-463d-b487-afeac84159cf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.943366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969bd20-3c88-4811-ad55-41762a254e62 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.948317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.998197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edb7ef-1653-463d-b487-afeac84159cf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.019717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.020756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.021238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.021699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.023243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:22.023780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.026651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.039345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.040298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.040762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.041220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.053824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.055658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.070134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 259/530] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:22.070134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:22.079073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:22.080069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:22.080941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:22.080941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:22.080941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:22.082853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 272/531] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:22.083890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.103965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.201288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed64bc-66a7-4e9f-be84-948d128f9fd1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.211900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.241018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.242010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.242573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.243082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.244397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=d9452756fb5049678dd3aac0d5be651d) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:22.244914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.247737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.254703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 273/532] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/role_assignments?user.id=d9452756fb5049678dd3aac0d5be651d&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:22.255905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.279212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee729bd-adc1-4543-b818-af9939b402b8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.346203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcf48a-903a-421f-9c91-a75ffc5b2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.347279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf48a-903a-421f-9c91-a75ffc5b2555 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.347689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf48a-903a-421f-9c91-a75ffc5b2555 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.348097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcf48a-903a-421f-9c91-a75ffc5b2555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.366842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcf48a-903a-421f-9c91-a75ffc5b2555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.369975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcf48a-903a-421f-9c91-a75ffc5b2555 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-44fcf48a-903a-421f-9c91-a75ffc5b2555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:22.400761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:22.402597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:22.404298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:22.404298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:22.404298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:22.404298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 260/533] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:22.406215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524c85-134e-4cca-b5e7-628628c680ba None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.406845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524c85-134e-4cca-b5e7-628628c680ba None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.407983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524c85-134e-4cca-b5e7-628628c680ba None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.410296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 261/534] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:22.414807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c524c85-134e-4cca-b5e7-628628c680ba None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.427498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc654fc-4552-4f33-b4c8-7a3697301cc0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.482009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076596-84a3-45a6-9522-c9ebcd095ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.482688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076596-84a3-45a6-9522-c9ebcd095ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.483125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076596-84a3-45a6-9522-c9ebcd095ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.483352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076596-84a3-45a6-9522-c9ebcd095ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.484444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076596-84a3-45a6-9522-c9ebcd095ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:22.484758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076596-84a3-45a6-9522-c9ebcd095ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.486566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076596-84a3-45a6-9522-c9ebcd095ef0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.502724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 274/535] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:22.504140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b41c6-5c57-4c30-a305-fae8f18a1f7f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.504442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b41c6-5c57-4c30-a305-fae8f18a1f7f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.504724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b41c6-5c57-4c30-a305-fae8f18a1f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.518845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.525891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-360b41c6-5c57-4c30-a305-fae8f18a1f7f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:22.528084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-360b41c6-5c57-4c30-a305-fae8f18a1f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:22.556906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c524c85-134e-4cca-b5e7-628628c680ba None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.559495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.604265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.605937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.606404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.606820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.607675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:22.608282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.609910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.614514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 275/536] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:22.615654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b41c6-5c57-4c30-a305-fae8f18a1f7f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.629963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 262/537] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:22.638973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.873080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee53914-afb3-41d7-9404-9baf0d194be3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.892179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b41c6-5c57-4c30-a305-fae8f18a1f7f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.919062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.944791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.946125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.950338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.951026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.975918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.978964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.989957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.991427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.992128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.992779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:23.003579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:23.005079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 263/538] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:23.011056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.017841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.020968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:23.037321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:23.038343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:23.039206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:23.039206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:23.039206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:23.039206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:23.039206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:23.039206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:23.039206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:23.039206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:23.041464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 276/539] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:23.043163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.071149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.157842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c4f4d-5424-425f-85a5-0567ac4288b0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.176650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cbec2-6559-4a48-b67a-c8ac8f08c57f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.196635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.197705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.198182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.198772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.199699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:23.200211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.201971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.221096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 277/540] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:23.222677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.242472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150bd4b-b429-4dbf-9872-1bb373cef0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.243911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150bd4b-b429-4dbf-9872-1bb373cef0ea None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.244201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150bd4b-b429-4dbf-9872-1bb373cef0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.244617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150bd4b-b429-4dbf-9872-1bb373cef0ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.262857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150bd4b-b429-4dbf-9872-1bb373cef0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d150bd4b-b429-4dbf-9872-1bb373cef0ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:23.272257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:23.273201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:23.274026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:23.278500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 264/541] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:23.279680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150bd4b-b429-4dbf-9872-1bb373cef0ea None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.320504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.343234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba490af8-a672-4809-8838-580a6e6b376c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.381571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.382101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.383695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.384246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.384661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.385542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:23.386851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.388566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.403070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 278/542] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:23.404176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.479623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150bd4b-b429-4dbf-9872-1bb373cef0ea None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.522407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ff04e-b8e4-4d27-ba6e-4b1c35e18b26 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.547429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.548466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.548981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.549638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.551180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=8c37ab868df74cd5a36323f7db5699d7) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:23.551766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.554912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.563394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.564299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.564719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.565140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.566103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:23.566582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.574291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 265/543] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/role_assignments?user.id=8c37ab868df74cd5a36323f7db5699d7&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:23.574291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.574882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.611842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 279/544] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:23.624414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.631267 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.817022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073ab47-c4c9-4c85-9784-6a4045ee2a3f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.835721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.867092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493efa3f-ef53-4419-80cb-92503c0d40f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.868017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493efa3f-ef53-4419-80cb-92503c0d40f1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.868711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493efa3f-ef53-4419-80cb-92503c0d40f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.869185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493efa3f-ef53-4419-80cb-92503c0d40f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.871653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493efa3f-ef53-4419-80cb-92503c0d40f1 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=af3eef42cf30440aaf30f3ddb882fd04) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:23.872578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493efa3f-ef53-4419-80cb-92503c0d40f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.874303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493efa3f-ef53-4419-80cb-92503c0d40f1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.887319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 266/545] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/role_assignments?user.id=af3eef42cf30440aaf30f3ddb882fd04&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:23.889591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26fc70-5649-4dc9-aa2e-f322974e31df None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.890056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26fc70-5649-4dc9-aa2e-f322974e31df None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.890609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26fc70-5649-4dc9-aa2e-f322974e31df None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.893486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 267/546] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:23.903879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e1d7-0c14-47f8-a4b4-b55483203201 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.904506 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e1d7-0c14-47f8-a4b4-b55483203201 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.904999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e1d7-0c14-47f8-a4b4-b55483203201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.937876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09daa-c0fb-4004-ba5a-b991d178ad61 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.944900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ecc9e1d7-0c14-47f8-a4b4-b55483203201 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:23.949383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ecc9e1d7-0c14-47f8-a4b4-b55483203201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:24.017315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.018405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.018917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.019510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.050862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.052868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.078681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 268/547] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:24.079819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:24.081215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:24.082073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:24.082073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:24.082073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:24.090456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 280/548] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:24.096386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9e1d7-0c14-47f8-a4b4-b55483203201 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.241100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9e1d7-0c14-47f8-a4b4-b55483203201 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.260854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:24.331610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.332603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.333096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.333566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.334893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:24.335505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.338173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.371302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 269/549] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:24.372569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.398468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.506522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:24.571676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e445a-ae96-41eb-8add-50627f9c160f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.583604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecc2e9-2dd9-452c-8761-14e11ef61fc6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.617089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604bd9d-e85d-469c-8dca-038f46dc0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.617735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604bd9d-e85d-469c-8dca-038f46dc0a8b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.618017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604bd9d-e85d-469c-8dca-038f46dc0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.618592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604bd9d-e85d-469c-8dca-038f46dc0a8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.638833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604bd9d-e85d-469c-8dca-038f46dc0a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b604bd9d-e85d-469c-8dca-038f46dc0a8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:24.645713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:24.646677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:24.647488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:24.650713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 281/550] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:24.653563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea150b77-b84d-49a0-87a0-46f1dbe5fcf5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.654073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea150b77-b84d-49a0-87a0-46f1dbe5fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.654482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea150b77-b84d-49a0-87a0-46f1dbe5fcf5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.654783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725af9a1-920c-4ab0-b3e2-ef7d17c91d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.655593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725af9a1-920c-4ab0-b3e2-ef7d17c91d6e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.656019 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725af9a1-920c-4ab0-b3e2-ef7d17c91d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.656436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725af9a1-920c-4ab0-b3e2-ef7d17c91d6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.657295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 282/551] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:24.663260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea150b77-b84d-49a0-87a0-46f1dbe5fcf5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.671742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725af9a1-920c-4ab0-b3e2-ef7d17c91d6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.673406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725af9a1-920c-4ab0-b3e2-ef7d17c91d6e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-725af9a1-920c-4ab0-b3e2-ef7d17c91d6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:24.686301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:24.687497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:24.688423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 270/552] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:24.688998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883ac2-c45d-46be-8b67-10390b98c4a3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.692814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883ac2-c45d-46be-8b67-10390b98c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.692814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec883ac2-c45d-46be-8b67-10390b98c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.716112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ec883ac2-c45d-46be-8b67-10390b98c4a3 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:24.717485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ec883ac2-c45d-46be-8b67-10390b98c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:24.752741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:24.819871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea150b77-b84d-49a0-87a0-46f1dbe5fcf5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.822345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 271/553] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:24.823461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec883ac2-c45d-46be-8b67-10390b98c4a3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.850754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:24.869344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.870294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.871315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.872181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.874499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:24.875117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.877964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.896078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 283/554] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:24.906093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.110827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec883ac2-c45d-46be-8b67-10390b98c4a3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.114626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c248464-2fda-410c-8c08-13a5150de690 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.195652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.196289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.196570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.196945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.210298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.210298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.210298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.210298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.210966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:25.210966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.211191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.211321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.212410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:25.229478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:25.231221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:25.232372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:25.232372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:25.232372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:25.232372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 284/555] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:25.232593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.244681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 272/556] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:25.246093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.271647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.279941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.366659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f139e3-deb1-4491-b771-f836f97d35c3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.397108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de48a6-e026-41e1-ba53-6710f16c2f85 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.407165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714f235-c459-4684-84d6-d17a70d93aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.407805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714f235-c459-4684-84d6-d17a70d93aaf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.408287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714f235-c459-4684-84d6-d17a70d93aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.408637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714f235-c459-4684-84d6-d17a70d93aaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.422588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714f235-c459-4684-84d6-d17a70d93aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a714f235-c459-4684-84d6-d17a70d93aaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:25.428638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:25.430119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:25.431250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:25.434582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 285/557] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:25.435744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714f235-c459-4684-84d6-d17a70d93aaf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.450173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.451073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.451531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.451957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.453447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:25.453949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.456045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.472827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 273/558] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:25.473989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.557725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.571614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714f235-c459-4684-84d6-d17a70d93aaf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.587247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.617128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5661a-ffef-4c78-83c3-3ff7c816a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.618101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5661a-ffef-4c78-83c3-3ff7c816a066 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.618974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5661a-ffef-4c78-83c3-3ff7c816a066 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.619561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5661a-ffef-4c78-83c3-3ff7c816a066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.623475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057c27-a39f-404c-9d32-d0fb9eba1aeb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.672952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.673587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.673879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.674159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.675322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:25.675655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.677374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.694911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 274/559] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:25.694911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.713474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5661a-ffef-4c78-83c3-3ff7c816a066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.715791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5661a-ffef-4c78-83c3-3ff7c816a066 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.822887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43291dc-4074-4f49-bdcc-cf794005f2a0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.851481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.867534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 286/560] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:25.869063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5661a-ffef-4c78-83c3-3ff7c816a066 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.878192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.879319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.879802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.880340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.883908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.892829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.894844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:25.909252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:25.910310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:25.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:25.914206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 275/561] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:25.915634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.015064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5661a-ffef-4c78-83c3-3ff7c816a066 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.063383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:26.064553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.065038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.065509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.075811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2af1b-5ebd-42d9-994e-090ec2716f96 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.080233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.082224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:26.100879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:26.101891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:26.102816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:26.102816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:26.102816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:26.110076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 287/562] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:26.111421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.148513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:26.149521 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.149943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.150830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.176282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:26.178612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.183519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:26.213349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:26.214518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:26.215413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:26.215413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:26.215413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:26.215586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 276/563] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:26.216983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.268213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826bd66-25ca-4b58-b21f-4e3991c70d8f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.285149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:26.334804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae0b9a-851c-46ca-b7af-66c2ef6d0298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:26.335816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae0b9a-851c-46ca-b7af-66c2ef6d0298 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.336310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae0b9a-851c-46ca-b7af-66c2ef6d0298 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.336796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae0b9a-851c-46ca-b7af-66c2ef6d0298 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.338159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae0b9a-851c-46ca-b7af-66c2ef6d0298 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:26.338747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae0b9a-851c-46ca-b7af-66c2ef6d0298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.342073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae0b9a-851c-46ca-b7af-66c2ef6d0298 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:26.355009 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a6b0-c360-43d4-beff-94a878cf38bf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.375907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 288/564] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:26.375907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8593-11f2-4e70-9576-ee016e13b3a3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.376706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8593-11f2-4e70-9576-ee016e13b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.376955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8593-11f2-4e70-9576-ee016e13b3a3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.386566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 289/565] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:26.386566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8593-11f2-4e70-9576-ee016e13b3a3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.431895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:26.432567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.433526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.433890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.434863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:26.435261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.438542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:26.461947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 277/566] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:26.461947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.566330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:26.572311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8593-11f2-4e70-9576-ee016e13b3a3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.602160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818975dc-fc36-4839-b7d8-af5a66058504 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.614015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:26.616666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773a4ce-d27f-4c57-9670-850344fa594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:26.617531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a4ce-d27f-4c57-9670-850344fa594c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.617816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a4ce-d27f-4c57-9670-850344fa594c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.618091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a4ce-d27f-4c57-9670-850344fa594c None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.619040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a4ce-d27f-4c57-9670-850344fa594c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:26.619332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a4ce-d27f-4c57-9670-850344fa594c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.621265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a4ce-d27f-4c57-9670-850344fa594c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:26.633630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 290/567] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:26.634894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d646ae-a171-49fd-b677-8028758ea996 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.635182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d646ae-a171-49fd-b677-8028758ea996 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.635452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d646ae-a171-49fd-b677-8028758ea996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.648532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:26.649411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.649727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.650046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.654962 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-30d646ae-a171-49fd-b677-8028758ea996 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:26.656208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-30d646ae-a171-49fd-b677-8028758ea996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:26.663377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.665900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:26.689629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:26.696334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:26.697648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:26.697648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:26.697648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:26.697648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 278/568] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:26.697648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.758105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 291/569] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:26.760240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd86b-7680-4195-a8f8-3fe8d6d4c1ac None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.760717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd86b-7680-4195-a8f8-3fe8d6d4c1ac None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.761241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddd86b-7680-4195-a8f8-3fe8d6d4c1ac None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.763680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 292/570] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:26.765056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddd86b-7680-4195-a8f8-3fe8d6d4c1ac None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.862428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648d9a4-9e70-45a8-b859-99c17ce91348 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.909927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:26.910860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.911297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.911942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.914178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:26.923945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.926016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:26.936896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddd86b-7680-4195-a8f8-3fe8d6d4c1ac None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:26.940587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:26.942918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 279/571] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:26.946635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.982588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:27.010223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f4dbd-3a1e-43ce-b6e5-9941441b9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:27.011259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f4dbd-3a1e-43ce-b6e5-9941441b9f00 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.011746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f4dbd-3a1e-43ce-b6e5-9941441b9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.012235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f4dbd-3a1e-43ce-b6e5-9941441b9f00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.024846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f4dbd-3a1e-43ce-b6e5-9941441b9f00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:27.028090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f4dbd-3a1e-43ce-b6e5-9941441b9f00 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d99f4dbd-3a1e-43ce-b6e5-9941441b9f00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:27.050412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:27.052350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 293/572] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287e26-fc3c-4f45-977c-568e2d15bf1f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.060846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287e26-fc3c-4f45-977c-568e2d15bf1f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.062060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287e26-fc3c-4f45-977c-568e2d15bf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.086633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-73287e26-fc3c-4f45-977c-568e2d15bf1f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:27.088714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-73287e26-fc3c-4f45-977c-568e2d15bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:27.096497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef57f1-9444-48e4-b795-3498905de1e4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:27.135222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:27.135838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.136666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.137091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.137597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:27.137897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:27.139309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:27.153367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 280/573] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:27.154325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:27.214896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 294/574] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:27.214896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73287e26-fc3c-4f45-977c-568e2d15bf1f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:27.263587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:27.290670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eb591-53dd-4cfb-8e51-85ef10bf0794 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:27.335179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:27.336072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.336503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.336940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.338000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:27.338586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:27.340902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:27.359601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:27.372841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 281/575] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:27.372841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:27.402781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73287e26-fc3c-4f45-977c-568e2d15bf1f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:27.468442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:27.469260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.469686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.470037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.470992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:27.471431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:27.474308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:27.493715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 295/576] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:27.496265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:27.541820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788f586-5348-4c08-ac95-d4d6b2cf8772 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:27.604088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582aa96-dabb-4552-bb39-f934a20043cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:27.605687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582aa96-dabb-4552-bb39-f934a20043cb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.606172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582aa96-dabb-4552-bb39-f934a20043cb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.606687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582aa96-dabb-4552-bb39-f934a20043cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.619450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:27.629567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582aa96-dabb-4552-bb39-f934a20043cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-4582aa96-dabb-4552-bb39-f934a20043cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:27.635657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:27.637529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:27.639132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:27.644116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 282/577] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:27.645099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582aa96-dabb-4552-bb39-f934a20043cb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:27.649954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b018c-5e1d-4328-9741-ee510b9cd8e9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:27.689512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:27.690222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.690618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.690959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.698816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:27.701000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:27.704275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:27.716169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:27.718068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:27.720048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:27.720048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:27.720048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:27.720048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:27.720048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:27.720048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:27.720048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:27.720048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:27.724397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 296/578] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:27.725290 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:27.766103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582aa96-dabb-4552-bb39-f934a20043cb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:27.817287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:27.818137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.818621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.819065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.835359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:27.837055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:27.856218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:27.858071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:27.859684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:27.859684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:27.859684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:27.863591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 283/579] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:27.864535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:27.867074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661efec-bb58-4d58-b5d5-32c71a9cb6c2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:27.912841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:27.913786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.914234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.914795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.916024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=ef9aa824aafe4c499df84fa0c3fe3f42) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:27.916531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:27.919692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:27.942300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 297/580] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:27 2022] GET /identity/v3/role_assignments?user.id=ef9aa824aafe4c499df84fa0c3fe3f42&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:27.942300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:27.942702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:28.037970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42abc7-6e47-4ac6-bb70-0e36891f987b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:28.067738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:28.085967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec932-9e5d-4143-957d-111d15433f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:28.087738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec932-9e5d-4143-957d-111d15433f8d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.087738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec932-9e5d-4143-957d-111d15433f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.088057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec932-9e5d-4143-957d-111d15433f8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.101517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec932-9e5d-4143-957d-111d15433f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-8acec932-9e5d-4143-957d-111d15433f8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:28.109053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:28.110932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 284/581] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:28.112581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec932-9e5d-4143-957d-111d15433f8d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.154601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9178aed-17eb-485b-9db2-b39df8a8037e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:28.216486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:28.217468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.217956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.218457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.219602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:28.220146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:28.222749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:28.238353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 298/582] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:28.239892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.255901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec932-9e5d-4143-957d-111d15433f8d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:28.271530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:28.306002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:28.306564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.306963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.307145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.307779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:28.308957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:28.310633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:28.327723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 285/583] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:28.328593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.428563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44a9d0-aa96-4600-bc3c-edb30c169ec9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:28.475978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:28.488650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:28.489651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.490051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.490510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.491505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:28.491949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:28.493936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:28.505558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8cf79-9fe5-4f11-b898-6db77cec9253 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:28.509643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 299/584] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:28.511550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.572875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:28.574212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.575013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.575191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.576248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:28.576686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:28.578560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:28.598798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 286/585] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:28.600664 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.645393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:28.684782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fb7a3-a10a-4926-ae8e-e72ac877adca None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:28.744700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:28.745230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa65990-780d-4d5f-a700-91fbe752de9b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:28.745470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.745950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.746523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.761800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:28.764031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:28.788857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:28.789911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:28.790894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:28.790894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:28.790894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:28.794746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc79f5-d6d3-435a-b1a2-ff3609f80543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:28.794984 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 300/586] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:28.795820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc79f5-d6d3-435a-b1a2-ff3609f80543 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.796261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc79f5-d6d3-435a-b1a2-ff3609f80543 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.796691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc79f5-d6d3-435a-b1a2-ff3609f80543 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/7949d9285d4e4c908c377a0ac16dd14d/roles/e9ad041f2bf540a9a37d7672449d853f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.797149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.819498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc79f5-d6d3-435a-b1a2-ff3609f80543 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=7949d9285d4e4c908c377a0ac16dd14d, role_id=e9ad041f2bf540a9a37d7672449d853f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:28.821528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc79f5-d6d3-435a-b1a2-ff3609f80543 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:28.843811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 287/587] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:28 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/7949d9285d4e4c908c377a0ac16dd14d/roles/e9ad041f2bf540a9a37d7672449d853f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:28.844955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc79f5-d6d3-435a-b1a2-ff3609f80543 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.894305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.036729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a2dcb-3ace-4cdd-a69b-18c1cb3c2761 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.038937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.069165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc79f5-d6d3-435a-b1a2-ff3609f80543 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.094787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.095438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.095795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.096151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.104063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.106764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:29.119606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:29.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:29.123981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 301/588] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:29.129244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.139954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.141265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.141957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.142710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.156907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.158748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:29.178765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:29.180443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:29.182066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:29.182066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:29.182066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:29.182066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 288/589] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:29.182066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.331009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.338450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851e67-6efe-4edc-818c-35c05842fa59 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.395422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918460d-ea9b-4b76-86c6-00eb9cc6f5cd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.398993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.399194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.399353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.399633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.400288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:29.400593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.402057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.419930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 302/590] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:29.419930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.451850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.453146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.453505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.454075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.454855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:29.455198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.457674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.459598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.479548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 289/591] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:29.481562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.592092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ebff7-8dda-4cae-b768-11dbd53aa187 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.599140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5909c33-63db-4f33-ba02-f38ca3a490ea None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.643221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.644326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.644840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.645340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.660439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.660832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.661362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.661785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.662215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.663435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:29.663651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.664073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.666528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:29.689474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:29.690538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:29.691480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:29.692013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 303/592] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:29.692013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.699684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 290/593] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:29.701349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.731822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.812980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.872348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9d38e-32a4-48d7-b0a9-62c33a0f0519 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.905673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc2069-6e1d-498f-8ce9-fca10760ab64 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.911740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.912313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.912596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.912928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.922350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.923825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:29.936755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:29.939030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 291/594] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:29.941160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.975106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb94e67-0ea9-4d5e-811d-5ab30a6fc59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.976245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb94e67-0ea9-4d5e-811d-5ab30a6fc59d None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.976734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb94e67-0ea9-4d5e-811d-5ab30a6fc59d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.977225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb94e67-0ea9-4d5e-811d-5ab30a6fc59d None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/d9452756fb5049678dd3aac0d5be651d/roles/e9ad041f2bf540a9a37d7672449d853f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.004445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb94e67-0ea9-4d5e-811d-5ab30a6fc59d None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=d9452756fb5049678dd3aac0d5be651d, role_id=e9ad041f2bf540a9a37d7672449d853f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.006047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb94e67-0ea9-4d5e-811d-5ab30a6fc59d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.026415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 304/595] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:29 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/d9452756fb5049678dd3aac0d5be651d/roles/e9ad041f2bf540a9a37d7672449d853f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:30.028220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb94e67-0ea9-4d5e-811d-5ab30a6fc59d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.158445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9918556-c48c-4740-b81f-d2ab2ca73229 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.179967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.197157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.227182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb94e67-0ea9-4d5e-811d-5ab30a6fc59d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.237466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d68c69-36f2-4146-919a-49a88c145d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.238207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68c69-36f2-4146-919a-49a88c145d61 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.238522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68c69-36f2-4146-919a-49a88c145d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.238796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68c69-36f2-4146-919a-49a88c145d61 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.239769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d68c69-36f2-4146-919a-49a88c145d61 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:30.239904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d68c69-36f2-4146-919a-49a88c145d61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.241285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d68c69-36f2-4146-919a-49a88c145d61 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.268629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 292/596] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:30.271813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08e71-52e6-4fdb-b7b8-030ec1e25360 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.272289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08e71-52e6-4fdb-b7b8-030ec1e25360 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.272781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08e71-52e6-4fdb-b7b8-030ec1e25360 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.275815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 293/597] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:30.277883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc08e71-52e6-4fdb-b7b8-030ec1e25360 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.295744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dd7a0-ea32-4cf1-bc1f-3aaa3b4db453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.296810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd7a0-ea32-4cf1-bc1f-3aaa3b4db453 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.297301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd7a0-ea32-4cf1-bc1f-3aaa3b4db453 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.297804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd7a0-ea32-4cf1-bc1f-3aaa3b4db453 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.299249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd7a0-ea32-4cf1-bc1f-3aaa3b4db453 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:30.299799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd7a0-ea32-4cf1-bc1f-3aaa3b4db453 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.302659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd7a0-ea32-4cf1-bc1f-3aaa3b4db453 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.330371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 305/598] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:30.331828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea3a3-1f98-493f-bece-6fc42a7b15aa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.332142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea3a3-1f98-493f-bece-6fc42a7b15aa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.332786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea3a3-1f98-493f-bece-6fc42a7b15aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.357341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-208ea3a3-1f98-493f-bece-6fc42a7b15aa None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:30.365612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-208ea3a3-1f98-493f-bece-6fc42a7b15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:30.410644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc08e71-52e6-4fdb-b7b8-030ec1e25360 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.455320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.456454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.456747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.457025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.469879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.471412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.486360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 306/599] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:30.487410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea3a3-1f98-493f-bece-6fc42a7b15aa None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:30.489607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:30.490626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:30.491780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:30.491780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.491780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:30.493140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 294/600] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:30.499365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.540448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.628323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.680809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea3a3-1f98-493f-bece-6fc42a7b15aa None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.708483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ff1b-c10d-43c7-8013-c087f925212c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.728737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.729393 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.729677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.731240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.760213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.761946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.768673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.769824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.770129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.770408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.771082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:30.771385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.773263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.788752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 295/601] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:30.796319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:30.798101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:30.799884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:30.799884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.799884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:30.800224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.800355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 307/602] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:30.812134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.918984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.931797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d3ae-0e0d-4608-89fc-29f3beeee66f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.972784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.973531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.973924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.974329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.983175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.984926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:30.998933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:31.000918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:31.002962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:31.002962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:31.002962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:31.002962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:31.002962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:31.002962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:31.002962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:31.002962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:31.004182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 296/603] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:31.013996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.047096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d021b-8aa6-45fd-9966-e56fcbcaaf51 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.068081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.101507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.102575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.103139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.103689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.106005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:31.106601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.109372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.134307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 308/604] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:31.135728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.242032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0009e5b-24a9-42da-b0d6-050fbe4b0aae None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.292467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54f9d5-4ed6-406e-b9bb-1ad4e064a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.293198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f9d5-4ed6-406e-b9bb-1ad4e064a8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.293545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f9d5-4ed6-406e-b9bb-1ad4e064a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.294824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f9d5-4ed6-406e-b9bb-1ad4e064a8b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.295194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54f9d5-4ed6-406e-b9bb-1ad4e064a8b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:31.295573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54f9d5-4ed6-406e-b9bb-1ad4e064a8b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.297089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54f9d5-4ed6-406e-b9bb-1ad4e064a8b5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.311758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 297/605] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:31.313486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd6b38-a481-427a-995e-d2f0f70fb241 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.313958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd6b38-a481-427a-995e-d2f0f70fb241 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.314436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd6b38-a481-427a-995e-d2f0f70fb241 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.316248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 298/606] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:31.317233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd6b38-a481-427a-995e-d2f0f70fb241 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.322467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.343954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a2d0c-c388-4f31-8fb4-3b7a1330e4a5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.392707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9673e2-6b0f-4cd1-89d5-5db735ab0eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.393870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9673e2-6b0f-4cd1-89d5-5db735ab0eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.394415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9673e2-6b0f-4cd1-89d5-5db735ab0eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.394969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9673e2-6b0f-4cd1-89d5-5db735ab0eb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.414585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9673e2-6b0f-4cd1-89d5-5db735ab0eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6d9673e2-6b0f-4cd1-89d5-5db735ab0eb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:31.425513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:31.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:31.427415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:31.428150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 309/607] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:31.429723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fed58-4133-4b6f-b22b-0b3da98ebb39 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.430222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fed58-4133-4b6f-b22b-0b3da98ebb39 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.430702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fed58-4133-4b6f-b22b-0b3da98ebb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.458509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d86fed58-4133-4b6f-b22b-0b3da98ebb39 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:31.460045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d86fed58-4133-4b6f-b22b-0b3da98ebb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:31.489946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.516539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd6b38-a481-427a-995e-d2f0f70fb241 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.549506 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 310/608] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:31.551640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fed58-4133-4b6f-b22b-0b3da98ebb39 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.569660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.571715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.572453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.572941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.585111 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.587947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:31.611879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:31.613510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:31.615277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:31.615277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:31.615277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:31.615277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:31.615277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:31.615277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:31.615277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:31.615277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:31.617605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 299/609] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:31.617605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.733113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fed58-4133-4b6f-b22b-0b3da98ebb39 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.748082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.807740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aa060-a21b-47cf-8dd5-c83f54850157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.810341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aa060-a21b-47cf-8dd5-c83f54850157 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.811283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aa060-a21b-47cf-8dd5-c83f54850157 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.811909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aa060-a21b-47cf-8dd5-c83f54850157 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/8c37ab868df74cd5a36323f7db5699d7/roles/e9ad041f2bf540a9a37d7672449d853f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.825305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d168-6396-427a-8d6d-d7ef7ebdef89 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.839870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354aa060-a21b-47cf-8dd5-c83f54850157 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=8c37ab868df74cd5a36323f7db5699d7, role_id=e9ad041f2bf540a9a37d7672449d853f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.841457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354aa060-a21b-47cf-8dd5-c83f54850157 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.858769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 311/610] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:31 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/8c37ab868df74cd5a36323f7db5699d7/roles/e9ad041f2bf540a9a37d7672449d853f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:31.858769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aa060-a21b-47cf-8dd5-c83f54850157 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.875512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.895778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.896978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.897316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.897803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.898967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:31.899421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.902853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.921266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 300/611] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:31.923041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.996940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aa060-a21b-47cf-8dd5-c83f54850157 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.040992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.041926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.042491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.042955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.043891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:32.044422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.046126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.061325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 312/612] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:32.064308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.133985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d560d-40e4-4baa-b421-bc7f937aae5b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.176024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4d35-bb24-49e0-8dbc-9122e2c4bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.177070 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4d35-bb24-49e0-8dbc-9122e2c4bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.177419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4d35-bb24-49e0-8dbc-9122e2c4bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.177900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4d35-bb24-49e0-8dbc-9122e2c4bfb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.181870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.198251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c4d35-bb24-49e0-8dbc-9122e2c4bfb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-8e1c4d35-bb24-49e0-8dbc-9122e2c4bfb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:32.205331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:32.206601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:32.207658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:32.214152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.214152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 301/613] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:32.215775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4d35-bb24-49e0-8dbc-9122e2c4bfb5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.240596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5ea57-ba8a-48b5-939a-b308aa4a074e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.301551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.302805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.303249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.303599 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.325470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.329161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.353241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4d35-bb24-49e0-8dbc-9122e2c4bfb5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:32.366738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:32.367982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:32.369263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:32.369263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:32.369263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:32.375314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 313/614] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:32.376185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.405599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92ac8-66f4-4d34-80f0-88d74055d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.407032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92ac8-66f4-4d34-80f0-88d74055d4b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.407835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92ac8-66f4-4d34-80f0-88d74055d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.408627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92ac8-66f4-4d34-80f0-88d74055d4b1 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/af3eef42cf30440aaf30f3ddb882fd04/roles/e9ad041f2bf540a9a37d7672449d853f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.432601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e92ac8-66f4-4d34-80f0-88d74055d4b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=af3eef42cf30440aaf30f3ddb882fd04, role_id=e9ad041f2bf540a9a37d7672449d853f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.435601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e92ac8-66f4-4d34-80f0-88d74055d4b1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.460221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 302/615] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:32 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/af3eef42cf30440aaf30f3ddb882fd04/roles/e9ad041f2bf540a9a37d7672449d853f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:32.461850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92ac8-66f4-4d34-80f0-88d74055d4b1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.530688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.550753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fabbd9-babe-4b4c-a76d-ab4881127099 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.591142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.611173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92ac8-66f4-4d34-80f0-88d74055d4b1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.631847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e14ce-90cc-428f-8445-c7697595e0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.633607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e14ce-90cc-428f-8445-c7697595e0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.634176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e14ce-90cc-428f-8445-c7697595e0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.635519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e14ce-90cc-428f-8445-c7697595e0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.637710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e14ce-90cc-428f-8445-c7697595e0f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:32.638380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e14ce-90cc-428f-8445-c7697595e0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.640741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e14ce-90cc-428f-8445-c7697595e0f4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.659345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003370e2-26a1-4185-87de-9fcc3e779075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.659345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003370e2-26a1-4185-87de-9fcc3e779075 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.659345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003370e2-26a1-4185-87de-9fcc3e779075 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.659345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003370e2-26a1-4185-87de-9fcc3e779075 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.659770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003370e2-26a1-4185-87de-9fcc3e779075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:32.659770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003370e2-26a1-4185-87de-9fcc3e779075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.660170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 314/616] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:32.660536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003370e2-26a1-4185-87de-9fcc3e779075 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.662539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1459-0007-4f55-aae6-d1bbb298c298 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.663060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1459-0007-4f55-aae6-d1bbb298c298 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.664306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1459-0007-4f55-aae6-d1bbb298c298 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.666246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 315/617] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:32.667396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1459-0007-4f55-aae6-d1bbb298c298 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.678307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 303/618] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:32.679619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3bc2c-4815-4440-9a3a-37999dda9e8b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.679914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3bc2c-4815-4440-9a3a-37999dda9e8b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.680185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3bc2c-4815-4440-9a3a-37999dda9e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.701922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c4e3bc2c-4815-4440-9a3a-37999dda9e8b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:32.703187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c4e3bc2c-4815-4440-9a3a-37999dda9e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:32.838167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 304/619] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:32.840337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3bc2c-4815-4440-9a3a-37999dda9e8b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.861952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1459-0007-4f55-aae6-d1bbb298c298 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.900289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.947579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.953069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.954397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.957575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.991436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.992942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:33.028424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:33.030613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:33.032276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:33.032276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:33.032276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:33.038694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 316/620] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:33.039675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.083543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3bc2c-4815-4440-9a3a-37999dda9e8b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.154527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.161945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.164751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.168818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.169667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.203564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.206108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:33.252289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:33.254108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:33.256660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 305/621] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:33.265264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.317853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c15cc6-a564-41fd-8b1f-f3654117eb15 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.397021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.397651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.397935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.398211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.398899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:33.400049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.401457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.423910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 317/622] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:33.424682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.501341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.519198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086c00d-3fee-4326-8f07-72615372aaa2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.560749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.561648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.562036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.562467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.563319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:33.563731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.565291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.600802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 306/623] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:33.603075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.614340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.633346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba20459-c472-477b-a9b4-5cba493e332c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.715424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a85d-d144-46a0-98d5-e5344d3c0078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.717630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a85d-d144-46a0-98d5-e5344d3c0078 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.718366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a85d-d144-46a0-98d5-e5344d3c0078 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.719281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a85d-d144-46a0-98d5-e5344d3c0078 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.744950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283a85d-d144-46a0-98d5-e5344d3c0078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f283a85d-d144-46a0-98d5-e5344d3c0078 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:33.759317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:33.761412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:33.763139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:33.769237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 318/624] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:33.770939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a85d-d144-46a0-98d5-e5344d3c0078 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.791136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15299f6d-7b6e-4547-9da2-e7acc521acfb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.860188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.862515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.863277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.864058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.879213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.882505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.900037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a85d-d144-46a0-98d5-e5344d3c0078 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:33.907385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:33.909245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:33.911123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:33.916111 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 307/625] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:33.918708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.925509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.947263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.949424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.950471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.951300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.967745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.969679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:33.988520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:33.989540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:33.990481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:33.990481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:33.990481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:33.990481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 319/626] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:33.991226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.005471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.126669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d0f1d-b60e-43cc-acd0-b6a8b7fd2234 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.133549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a2ed9-6a6f-462e-9aab-1edbc3935331 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.177892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.179316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.179892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.180344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.181262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:34.181838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.184394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.196560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.198173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.199278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.199895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.201275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:34.201926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.204707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.215373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 320/627] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.217032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.230819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 308/628] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.232680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.297244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.343522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca7bca-1275-4eaa-b292-02667e38791d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.364950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.391505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.392439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.392875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.393328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.394279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:34.394735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.396291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.411269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 321/629] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.412404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.446044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36007-0d68-40d3-879d-cda3c7020e48 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.517222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae8ded-6ed7-40fb-b2ab-c35f39f6b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.518302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae8ded-6ed7-40fb-b2ab-c35f39f6b885 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.518934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae8ded-6ed7-40fb-b2ab-c35f39f6b885 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.519568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae8ded-6ed7-40fb-b2ab-c35f39f6b885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.547429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80fa4b-6bef-42e6-8592-53f043cffde6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.576639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.590895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.593033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.595190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.595711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.615245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.617285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:34.635227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:34.637204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:34.639968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:34.639968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:34.639968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:34.639968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 322/630] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:34.639968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.661710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae8ded-6ed7-40fb-b2ab-c35f39f6b885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.663643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae8ded-6ed7-40fb-b2ab-c35f39f6b885 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.765303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.799264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fcbe9-4a4d-4f1c-ab2a-7142536adfbe None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.824856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 309/631] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:34.827191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9659-8bef-4b10-83bf-6275c6ed0b0a None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.827752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9659-8bef-4b10-83bf-6275c6ed0b0a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.828304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9659-8bef-4b10-83bf-6275c6ed0b0a None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.835746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 310/632] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:34.836828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f9659-8bef-4b10-83bf-6275c6ed0b0a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.862548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.863451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.863907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.864371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.883491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.886044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:34.906783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:34.908552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 323/633] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:34.910711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.970063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:35.023403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f9659-8bef-4b10-83bf-6275c6ed0b0a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.074602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6ebb-dfd3-4277-969f-e0cf69f3884b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.082357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ff8df-d045-421f-a8b9-3cac673c3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.082985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff8df-d045-421f-a8b9-3cac673c3eda None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.083264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff8df-d045-421f-a8b9-3cac673c3eda None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.083538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff8df-d045-421f-a8b9-3cac673c3eda None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.084186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ff8df-d045-421f-a8b9-3cac673c3eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:35.084483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ff8df-d045-421f-a8b9-3cac673c3eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.085870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ff8df-d045-421f-a8b9-3cac673c3eda None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.098814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 311/634] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:35.101100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e63a9-08fe-4143-80be-891daaf3bd84 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.101784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e63a9-08fe-4143-80be-891daaf3bd84 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.101947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e63a9-08fe-4143-80be-891daaf3bd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.122884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.123686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.124048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.124483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.138283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9c1e63a9-08fe-4143-80be-891daaf3bd84 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:35.139815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9c1e63a9-08fe-4143-80be-891daaf3bd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:35.140630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.143557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.164716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:35.169264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:35.171122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:35.173465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:35.173465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:35.173465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:35.173465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 324/635] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:35.173465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.238330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 312/636] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:35.241281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f82978-6438-4039-a8a4-4c7fb5a77bf0 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.241782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f82978-6438-4039-a8a4-4c7fb5a77bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.242288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f82978-6438-4039-a8a4-4c7fb5a77bf0 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.245139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 313/637] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:35.247458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f82978-6438-4039-a8a4-4c7fb5a77bf0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.304847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:35.325804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8837af8-1c04-4468-9264-ad180b1dbbb6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.372966 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.373768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.374406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.374838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.375968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:35.376545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.378405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.401686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 325/638] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:35.401686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.457300 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f82978-6438-4039-a8a4-4c7fb5a77bf0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.525494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c5714-9bbe-4499-9735-da4630c7cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.526653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c5714-9bbe-4499-9735-da4630c7cc13 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.527172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c5714-9bbe-4499-9735-da4630c7cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.527650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c5714-9bbe-4499-9735-da4630c7cc13 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.541273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c5714-9bbe-4499-9735-da4630c7cc13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.544824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c5714-9bbe-4499-9735-da4630c7cc13 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.549402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4dfe-d6fe-4ff6-9117-bb989a93943a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-190c5714-9bbe-4499-9735-da4630c7cc13 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:35.569855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:35.571212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:35.572446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 314/639] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:35.575108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d20dbc-486c-439f-a9c5-b099dd96a09b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.575607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d20dbc-486c-439f-a9c5-b099dd96a09b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.576150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d20dbc-486c-439f-a9c5-b099dd96a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.592861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.593482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.593765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.594041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.594734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:35.595044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.596449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.607101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-73d20dbc-486c-439f-a9c5-b099dd96a09b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:35.609183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-73d20dbc-486c-439f-a9c5-b099dd96a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:35.613916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 326/640] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:35.613916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.627252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:35.631788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:35.702605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 315/641] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:35.703493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d20dbc-486c-439f-a9c5-b099dd96a09b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.778281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0075ba9-b7ac-404f-b9e1-1afc3e49e4d4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.846124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d20dbc-486c-439f-a9c5-b099dd96a09b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.848195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f170c-b1a7-4d24-97e7-4bea813e2d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.849303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f170c-b1a7-4d24-97e7-4bea813e2d04 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.849837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f170c-b1a7-4d24-97e7-4bea813e2d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.850318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f170c-b1a7-4d24-97e7-4bea813e2d04 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/ef9aa824aafe4c499df84fa0c3fe3f42/roles/e9ad041f2bf540a9a37d7672449d853f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.876132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f170c-b1a7-4d24-97e7-4bea813e2d04 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=ef9aa824aafe4c499df84fa0c3fe3f42, role_id=e9ad041f2bf540a9a37d7672449d853f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.878859 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f170c-b1a7-4d24-97e7-4bea813e2d04 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.910397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 327/642] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:35 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/ef9aa824aafe4c499df84fa0c3fe3f42/roles/e9ad041f2bf540a9a37d7672449d853f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:35.910718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c8c88-11d7-4f7a-953c-a372fcded4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.911506 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c8c88-11d7-4f7a-953c-a372fcded4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.911898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f170c-b1a7-4d24-97e7-4bea813e2d04 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.912073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c8c88-11d7-4f7a-953c-a372fcded4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.912352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c8c88-11d7-4f7a-953c-a372fcded4c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.938359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c8c88-11d7-4f7a-953c-a372fcded4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-814c8c88-11d7-4f7a-953c-a372fcded4c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:35.948336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:35.951447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:35.952925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:35.958987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 316/643] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:35.960479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c8c88-11d7-4f7a-953c-a372fcded4c3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.979347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.054935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.131203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f170c-b1a7-4d24-97e7-4bea813e2d04 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.161804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c8c88-11d7-4f7a-953c-a372fcded4c3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.179065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.179730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.180022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.180304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.181045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:36.181360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:36.182891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:36.206632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 328/644] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:36.208275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.220924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.221662 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.222015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.222427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.230386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:36.232034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:36.244410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:36.246204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 317/645] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:36.247745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.345939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10c9c-6c7c-43f9-99e1-f76ccf7f3c3e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.358766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.374071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.398187 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.398735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.399024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.399305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.399990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:36.400298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:36.402545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:36.418224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 329/646] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:36.419546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.426006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8ca42-cfed-4238-b576-1b6fe67a4903 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.501702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534446ba-545f-4abf-a3fb-882bc95133dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.502850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534446ba-545f-4abf-a3fb-882bc95133dd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.503338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534446ba-545f-4abf-a3fb-882bc95133dd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.503829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534446ba-545f-4abf-a3fb-882bc95133dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.523022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534446ba-545f-4abf-a3fb-882bc95133dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-534446ba-545f-4abf-a3fb-882bc95133dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:36.533298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:36.534472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:36.535500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:36.543246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 318/647] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:36.543246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534446ba-545f-4abf-a3fb-882bc95133dd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.573155 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226271b-383e-43ac-8a41-ed773274d856 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.626677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62456f-dbc7-4d65-b774-aa8ebd8385c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.627714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62456f-dbc7-4d65-b774-aa8ebd8385c3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.628203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62456f-dbc7-4d65-b774-aa8ebd8385c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.628693 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62456f-dbc7-4d65-b774-aa8ebd8385c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.721617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.739369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534446ba-545f-4abf-a3fb-882bc95133dd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.763911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62456f-dbc7-4d65-b774-aa8ebd8385c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:36.766437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62456f-dbc7-4d65-b774-aa8ebd8385c3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:36.783231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.797183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.798106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.798563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.798974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.799825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:36.800766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:36.802662 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:36.825463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 319/648] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:36.825463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.937459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 330/649] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:36.937459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62456f-dbc7-4d65-b774-aa8ebd8385c3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.993601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122673ec-72d2-4c8f-b82e-ed87a1135c25 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.044618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.045311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.045642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.045985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.058737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.060653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.062702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:37.082478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:37.084273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:37.086005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:37.086005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:37.086005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:37.086005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 320/650] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:37.086005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.093077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62456f-dbc7-4d65-b774-aa8ebd8385c3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.139186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.139870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.140154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.140998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.141700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:37.142186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.143774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.159067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 331/651] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:37.160606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.165409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.285972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371375b-af90-415d-b462-f7c8061ea112 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.306506 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74f365-c4c2-4970-a1ce-ac1ab140ca14 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.341934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.342791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.343221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.343629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.344884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=7949d9285d4e4c908c377a0ac16dd14d) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:37.345331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.347161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.362634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 321/652] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/role_assignments?user.id=7949d9285d4e4c908c377a0ac16dd14d&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:37.362634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.380807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.382116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.382983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.383615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.403229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.407860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.411102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:37.451108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:37.452274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:37.453183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:37.453183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:37.453183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:37.455690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 332/653] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:37.458864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.580638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186350a5-8379-460a-adf6-adc307dcdee9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.583441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.638518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27472-7224-47f3-8993-48cbe6e9e8c1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.672914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.673962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.675471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.675471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.676418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:37.676696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.679301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.698182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.699343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.699825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.700317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.704487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 322/654] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:37.705475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.720929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.722817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:37.741002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:37.742198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:37.743548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:37.743548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:37.743548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:37.747026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 333/655] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:37.748186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.828096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.862798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96232-3d59-4044-8698-03c997ce078a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.904814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.905696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.906181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.906649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.907463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:37.907918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.910573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.924558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 323/656] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:37.925816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.937395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791b126-a9db-4b8f-b403-f96487ec4c81 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.956754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.005532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.006931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.007438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.008297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.026106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.029276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.048927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6bbd2-dbd8-44e1-996d-d293491d9728 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:38.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:38.057751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:38.059755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:38.060312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 334/657] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:38.061535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.094354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.095425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.095995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.096475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.097368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:38.097881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.099539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.115014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 324/658] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:38.116370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.216822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.241657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96237d4d-ac70-4f39-903c-84b276395773 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.254744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e03ae3-8144-493d-a301-bddf80cfed06 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.258181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.297014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.297664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.297945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.298221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.299155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4cc0a-720c-4ced-8ab4-d72d842f221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.300277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4cc0a-720c-4ced-8ab4-d72d842f221f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.300783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4cc0a-720c-4ced-8ab4-d72d842f221f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.301267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4cc0a-720c-4ced-8ab4-d72d842f221f None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.302683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4cc0a-720c-4ced-8ab4-d72d842f221f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:38.303270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4cc0a-720c-4ced-8ab4-d72d842f221f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.306013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4cc0a-720c-4ced-8ab4-d72d842f221f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.309305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.311023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:38.324776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:38.326729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:38.328331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:38.328331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:38.328331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:38.328331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:38.328331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:38.328331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:38.328331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:38.328331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:38.330301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 335/659] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:38.331253 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.353675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 325/660] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:38.353675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc75bd-1c28-455c-adfb-e8ec291cd2d3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.353675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc75bd-1c28-455c-adfb-e8ec291cd2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.353675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc75bd-1c28-455c-adfb-e8ec291cd2d3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.353675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 326/661] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:38.354391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc75bd-1c28-455c-adfb-e8ec291cd2d3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.513644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2161ec-5f70-4567-9f9d-0ea5dc6db653 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.555341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc75bd-1c28-455c-adfb-e8ec291cd2d3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.568466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.569133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.569401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.569679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.579429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.580933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:38.594074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:38.596152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 336/662] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:38.597968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.632258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10693f-058f-4d80-8a5a-ac5085378137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.633791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10693f-058f-4d80-8a5a-ac5085378137 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.634526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.636730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10693f-058f-4d80-8a5a-ac5085378137 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.637888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10693f-058f-4d80-8a5a-ac5085378137 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.639502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10693f-058f-4d80-8a5a-ac5085378137 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:38.640266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10693f-058f-4d80-8a5a-ac5085378137 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.643294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10693f-058f-4d80-8a5a-ac5085378137 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.660630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.675445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 327/663] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:38.677811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5193e7d-274d-47b3-b9d5-fb8fc3538a40 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.678350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5193e7d-274d-47b3-b9d5-fb8fc3538a40 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.678817 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5193e7d-274d-47b3-b9d5-fb8fc3538a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.708996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e5193e7d-274d-47b3-b9d5-fb8fc3538a40 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:38.711707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e5193e7d-274d-47b3-b9d5-fb8fc3538a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:38.734083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437482-f676-4948-8a36-7894a8bcc7be None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.790550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58e4f-1f05-4ee6-ac01-7097b81b9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.791910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58e4f-1f05-4ee6-ac01-7097b81b9bbd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.793328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58e4f-1f05-4ee6-ac01-7097b81b9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.794027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58e4f-1f05-4ee6-ac01-7097b81b9bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.844238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 328/664] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:38.850529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5193e7d-274d-47b3-b9d5-fb8fc3538a40 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.900456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f58e4f-1f05-4ee6-ac01-7097b81b9bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.902008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f58e4f-1f05-4ee6-ac01-7097b81b9bbd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.929985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.022637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 337/665] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:39.023561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58e4f-1f05-4ee6-ac01-7097b81b9bbd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.032590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5193e7d-274d-47b3-b9d5-fb8fc3538a40 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.089834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.101016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.101990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.102531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.103010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.104616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:39.104958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.107737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.143182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 329/666] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:39.144142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.156694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58e4f-1f05-4ee6-ac01-7097b81b9bbd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.190153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.206143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.206585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.206763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.207041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.207802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=d9452756fb5049678dd3aac0d5be651d) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:39.208299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.210037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.226323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 338/667] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/role_assignments?user.id=d9452756fb5049678dd3aac0d5be651d&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:39.226323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.293651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c808824-bab8-4af8-a62e-03ef19a7082a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.334806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.335611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.335990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.336363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.348203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.349866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:39.367237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:39.369632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:39.372164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:39.372164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:39.372164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:39.375953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 330/668] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:39.377500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.424953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf145-d42c-4e8e-a27b-4e3e49cf3dac None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.425896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.493609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341768c-370b-41e5-9c79-52ac68e44ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.494685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341768c-370b-41e5-9c79-52ac68e44ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.495065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341768c-370b-41e5-9c79-52ac68e44ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.495365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341768c-370b-41e5-9c79-52ac68e44ac1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.511149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341768c-370b-41e5-9c79-52ac68e44ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9341768c-370b-41e5-9c79-52ac68e44ac1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:39.517385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:39.520213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 339/669] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:39.522592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341768c-370b-41e5-9c79-52ac68e44ac1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.539762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dddbb-6d22-490b-acf8-406715d4e3d2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.592370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.596198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca3445-d5c5-44de-9f76-92217014697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.596830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca3445-d5c5-44de-9f76-92217014697b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.597110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca3445-d5c5-44de-9f76-92217014697b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.597384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca3445-d5c5-44de-9f76-92217014697b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.671223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341768c-370b-41e5-9c79-52ac68e44ac1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.711366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca3445-d5c5-44de-9f76-92217014697b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.712854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca3445-d5c5-44de-9f76-92217014697b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.716451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.717405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.717900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.718507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.719385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:39.719902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.721547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.741631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 340/670] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:39.744006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.798665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.844702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 331/671] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:39.846091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca3445-d5c5-44de-9f76-92217014697b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.961645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b1f2-b784-4882-8815-84ea2370a512 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.977659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.988654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca3445-d5c5-44de-9f76-92217014697b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.013685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.015267 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.015778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.016263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.017181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.018071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.020133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.033917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 341/672] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.035281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.071851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.073084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.078490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.080042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.091571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.093616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.097407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:40.108739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:40.109795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:40.110826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:40.110826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:40.110826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:40.110826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:40.110826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:40.110826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:40.110826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:40.110826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:40.113164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 332/673] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:40.114391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.244890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0237-a6c2-4568-905f-d4ccc3c8706f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.245869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d286d-1073-4c3a-a192-4a46bf3276da None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.288880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.289807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.290332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.290792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.304684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.305713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bcc51-3b29-4473-b2ef-38bcc35d0797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.306153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.306612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bcc51-3b29-4473-b2ef-38bcc35d0797 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.307077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bcc51-3b29-4473-b2ef-38bcc35d0797 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.307529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bcc51-3b29-4473-b2ef-38bcc35d0797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:40.323578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:40.326213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:40.328761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:40.328761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:40.328761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:40.330170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 333/674] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:40.333633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.333804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bcc51-3b29-4473-b2ef-38bcc35d0797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.336498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bcc51-3b29-4473-b2ef-38bcc35d0797 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-564bcc51-3b29-4473-b2ef-38bcc35d0797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:40.364093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:40.365099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:40.365994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:40.365994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:40.365994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:40.365994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 342/675] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:40.368123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aaa20-4113-47b3-b27b-efac76939125 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.368881 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aaa20-4113-47b3-b27b-efac76939125 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.369367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aaa20-4113-47b3-b27b-efac76939125 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.378630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 343/676] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:40.380067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aaa20-4113-47b3-b27b-efac76939125 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.411949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.436474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.534942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c002c5-82e6-4e29-972b-583e36576a38 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.540578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aaa20-4113-47b3-b27b-efac76939125 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.581450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.582267 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.582564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.582840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.583926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.584237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.585805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.596212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db25ae-f52f-4aa3-bc87-7979947c3013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.597175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db25ae-f52f-4aa3-bc87-7979947c3013 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.597550 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db25ae-f52f-4aa3-bc87-7979947c3013 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.597936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db25ae-f52f-4aa3-bc87-7979947c3013 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.599051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db25ae-f52f-4aa3-bc87-7979947c3013 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.599517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db25ae-f52f-4aa3-bc87-7979947c3013 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.604384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 344/677] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.604384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.604682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db25ae-f52f-4aa3-bc87-7979947c3013 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.625273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 334/678] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.627323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8dcb1-b4e8-4718-a6d4-1183978109bd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.627867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8dcb1-b4e8-4718-a6d4-1183978109bd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.628543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8dcb1-b4e8-4718-a6d4-1183978109bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.651433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b9e8dcb1-b4e8-4718-a6d4-1183978109bd None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:40.653785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b9e8dcb1-b4e8-4718-a6d4-1183978109bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:40.717006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.746337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 335/679] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:40.746337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8dcb1-b4e8-4718-a6d4-1183978109bd None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.762176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f177a-ab45-4dfd-8bd0-9cf1afa32061 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.805008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.822945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.824436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.824720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.824995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.825953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.826789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.828522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.847164 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 345/680] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.848147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.878208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8dcb1-b4e8-4718-a6d4-1183978109bd None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.931246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.932528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.933405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.933623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.948043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.950304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:40.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:40.969605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:40.971633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:40.977040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 336/681] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:40.977040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.983283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee7ed-a369-49f5-a8bc-ed4aa06fa1e6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.023636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.024441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.024823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.025200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.026102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=8c37ab868df74cd5a36323f7db5699d7) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:41.027119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.028955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.043210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 346/682] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/role_assignments?user.id=8c37ab868df74cd5a36323f7db5699d7&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:41.044419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.060912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.132728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff40bd-6363-4e98-97d4-4d116677b3f5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.146995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.187602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.188721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.189281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.189765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.196036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bb521-4ea6-40b4-a18a-7e8f1c430320 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.199823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.201768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:41.216589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:41.217581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:41.218540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 337/683] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:41.221441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.252814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.253474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.253760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.254035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.254859 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:41.255148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.256663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.281357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 347/684] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:41.282531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.356754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781b4d-d939-4373-af33-bb998f97f3c8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.393338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.401052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb45f51-b6aa-42f2-8b2a-fed4c1f4f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.402311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45f51-b6aa-42f2-8b2a-fed4c1f4f292 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.403117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45f51-b6aa-42f2-8b2a-fed4c1f4f292 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.403463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45f51-b6aa-42f2-8b2a-fed4c1f4f292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.416488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb45f51-b6aa-42f2-8b2a-fed4c1f4f292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-dfb45f51-b6aa-42f2-8b2a-fed4c1f4f292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:41.422544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:41.424398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 338/685] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:41.425882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb45f51-b6aa-42f2-8b2a-fed4c1f4f292 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.471170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a2683-ba07-4085-9793-1f49d28cb82e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.482688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.549627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.550661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.551125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.551594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.552886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:41.553418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.556190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.580145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 348/686] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:41.581787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.593513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb45f51-b6aa-42f2-8b2a-fed4c1f4f292 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.648233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8742f2-ea0a-4fc8-a3ae-f52b4e629b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.649232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8742f2-ea0a-4fc8-a3ae-f52b4e629b84 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.649742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8742f2-ea0a-4fc8-a3ae-f52b4e629b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.650775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8742f2-ea0a-4fc8-a3ae-f52b4e629b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.742112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8742f2-ea0a-4fc8-a3ae-f52b4e629b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.744376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8742f2-ea0a-4fc8-a3ae-f52b4e629b84 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.755925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b97d6-8bac-40e5-bc72-d6e0b03530d7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.773898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.798655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.817277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.818012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.818325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.818605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.819284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:41.819598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.820999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.835932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 349/687] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:41.836773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.928797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 339/688] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:41.930205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8742f2-ea0a-4fc8-a3ae-f52b4e629b84 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.979492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317195fc-a37c-4b77-8dba-f79526787604 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.046795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd1524-9972-4a8e-a7df-f21d9b9a12c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.048281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1524-9972-4a8e-a7df-f21d9b9a12c8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.049171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1524-9972-4a8e-a7df-f21d9b9a12c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.049815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd1524-9972-4a8e-a7df-f21d9b9a12c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.051361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd1524-9972-4a8e-a7df-f21d9b9a12c8 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=af3eef42cf30440aaf30f3ddb882fd04) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:42.051948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8742f2-ea0a-4fc8-a3ae-f52b4e629b84 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.052359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd1524-9972-4a8e-a7df-f21d9b9a12c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.055642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd1524-9972-4a8e-a7df-f21d9b9a12c8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.067548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 350/689] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/role_assignments?user.id=af3eef42cf30440aaf30f3ddb882fd04&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:42.069917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99734e3-3029-4ee7-8ca9-b507c72c4910 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.070642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99734e3-3029-4ee7-8ca9-b507c72c4910 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.071320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99734e3-3029-4ee7-8ca9-b507c72c4910 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.074977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 351/690] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:42.076767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99734e3-3029-4ee7-8ca9-b507c72c4910 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.091291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.113901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0778c-e499-455a-98c1-76e26aeaa154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.114603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0778c-e499-455a-98c1-76e26aeaa154 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.114882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0778c-e499-455a-98c1-76e26aeaa154 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.115164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0778c-e499-455a-98c1-76e26aeaa154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.133313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0778c-e499-455a-98c1-76e26aeaa154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.136721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0778c-e499-455a-98c1-76e26aeaa154 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-c4b0778c-e499-455a-98c1-76e26aeaa154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:42.169918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:42.171043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:42.171970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:42.171970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:42.171970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:42.174524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 340/691] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:42.176128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695ca80-b223-4f3f-9765-7a9636fc46c5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.176633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695ca80-b223-4f3f-9765-7a9636fc46c5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.177135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695ca80-b223-4f3f-9765-7a9636fc46c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.183940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.206147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8695ca80-b223-4f3f-9765-7a9636fc46c5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:42.208879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8695ca80-b223-4f3f-9765-7a9636fc46c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:42.272064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99734e3-3029-4ee7-8ca9-b507c72c4910 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.315279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 341/692] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:42.315279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695ca80-b223-4f3f-9765-7a9636fc46c5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.338906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.341191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.341492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.342690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.364938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.367220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:42.398947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:42.400864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:42.403058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:42.403058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:42.403058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:42.403058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 352/693] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:42.409357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.517963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695ca80-b223-4f3f-9765-7a9636fc46c5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.523591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.574949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.577946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.577946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.578193 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.578989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:42.579501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.581535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.597310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 342/694] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:42.603737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.678439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efeb47-7b73-4d21-9990-e2b049cf29e0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.681305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.755696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.756677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.757646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.758181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.759623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:42.760501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.764396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.767843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdddbe-837a-41cc-a9a7-43b687a21ee3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.793189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 353/695] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:42.794968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.853777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.855588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.856082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.856802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.874204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.876844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:42.899423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:42.901520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:42.903966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:42.914289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 343/696] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:42.914289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.965469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.997218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76cc42-a98f-48ef-a0f7-a10f74dcbf02 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.068237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.069332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.069813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.070410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.092402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.095355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.107915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44082efe-557e-4955-8c70-801f867e07ca None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:43.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:43.127608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:43.135563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:43.135563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:43.135563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:43.135563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 354/697] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:43.135563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.160159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:43.183766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.185233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.185746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.186248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.199884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.202742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:43.226152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:43.228336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:43.230678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:43.230678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:43.230678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:43.230678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:43.230678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:43.230678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:43.230678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:43.230678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:43.238285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 344/698] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:43.238285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.326641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b9589-fca8-4728-9611-2fc2f1ae511d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.374676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:43.396809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a5374-ba86-4ad4-b5b3-df7901b122e4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.398252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.399501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.400130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.400602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.402023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:43.402680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.405568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.441727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.442067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 355/699] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:43.443508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.447395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.447879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.448398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.450203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:43.451498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.456329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.486356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 345/700] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:43.487928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.578486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:43.617952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f708-30af-4d51-826c-bd0b5d3ab227 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.640150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ecebf-2c1a-41c0-9c0a-d853a4d953ce None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.688681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7c433-f64e-4e62-b941-afb205297dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.689662 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c433-f64e-4e62-b941-afb205297dbe None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.690153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c433-f64e-4e62-b941-afb205297dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.690592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c433-f64e-4e62-b941-afb205297dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.696214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.697164 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.697634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.698101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.699607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:43.699963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.702509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.718910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:43.734301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 356/701] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:43.734301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.828646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7c433-f64e-4e62-b941-afb205297dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.831324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7c433-f64e-4e62-b941-afb205297dbe None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.898891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36798b1-c5ff-4cd1-b1c4-5c25504f23f0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.949421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:43.960145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bdf17-6ffc-4064-8558-5b2da0450306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.962230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bdf17-6ffc-4064-8558-5b2da0450306 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.963223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bdf17-6ffc-4064-8558-5b2da0450306 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.964008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bdf17-6ffc-4064-8558-5b2da0450306 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.966232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bdf17-6ffc-4064-8558-5b2da0450306 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.970221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bdf17-6ffc-4064-8558-5b2da0450306 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:44.000074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 346/702] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:44.001469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedbd1c-d400-48f1-86a2-8f55d7af5137 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.001909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedbd1c-d400-48f1-86a2-8f55d7af5137 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.002287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedbd1c-d400-48f1-86a2-8f55d7af5137 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.006346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 347/703] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:44.006346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedbd1c-d400-48f1-86a2-8f55d7af5137 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:44.018357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 357/704] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:02:43 2022] POST /identity/v3/users => generated 254 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:44.018357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bdf17-6ffc-4064-8558-5b2da0450306 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:44.137837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:44.239246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bdf17-6ffc-4064-8558-5b2da0450306 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:44.273815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedbd1c-d400-48f1-86a2-8f55d7af5137 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:44.284684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ff369-b2d7-42f4-ac60-6830041b6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:44.285343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff369-b2d7-42f4-ac60-6830041b6845 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.285628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff369-b2d7-42f4-ac60-6830041b6845 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.285910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ff369-b2d7-42f4-ac60-6830041b6845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.302031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ff369-b2d7-42f4-ac60-6830041b6845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:44.303801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ff369-b2d7-42f4-ac60-6830041b6845 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-660ff369-b2d7-42f4-ac60-6830041b6845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:44.322899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:44.325074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:44.326748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:44.326748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:44.326748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:44.329646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 358/705] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:44.331248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f48a-82ad-4906-b64b-8758d68b5376 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.331541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f48a-82ad-4906-b64b-8758d68b5376 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.331828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f48a-82ad-4906-b64b-8758d68b5376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.343161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:44.344169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.344638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.345112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.350329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=ef9aa824aafe4c499df84fa0c3fe3f42) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:44.350329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:44.350329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:44.360955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 348/706] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:44 2022] GET /identity/v3/role_assignments?user.id=ef9aa824aafe4c499df84fa0c3fe3f42&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:44.365284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5620f48a-82ad-4906-b64b-8758d68b5376 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:44.367759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5620f48a-82ad-4906-b64b-8758d68b5376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:44.371280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:44.443855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:44.524892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 359/707] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:44.527876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c009-b4b3-4cb1-b615-69647cc668c0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.528654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c009-b4b3-4cb1-b615-69647cc668c0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.529358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c009-b4b3-4cb1-b615-69647cc668c0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.532776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 360/708] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:44.539969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3fd65-1386-4346-b70b-8d3914397481 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.540844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3fd65-1386-4346-b70b-8d3914397481 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.541613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3fd65-1386-4346-b70b-8d3914397481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.608352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11098e0-3883-46fb-a7f0-0a465aaf3974 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:44.613828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b4f3fd65-1386-4346-b70b-8d3914397481 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:44.615756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b4f3fd65-1386-4346-b70b-8d3914397481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:44.626711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:44.669070 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:44.669981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.670284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.670575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.671234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:44.671539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:44.672922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:44.686017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 349/709] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:44.694932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:44.741889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 361/710] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:44.817841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5583d-f62e-4e52-a6cd-b1c10495e4c2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:44.853612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:44.854313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.854599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.855584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.863047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:44.864488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:44.878083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:44.879114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:44.880290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 350/711] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:44.887631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3fd65-1386-4346-b70b-8d3914397481 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:45.003230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:45.006951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3fd65-1386-4346-b70b-8d3914397481 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:45.048517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:45.049130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.049407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.049681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.050406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:45.050714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:45.052148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:45.066426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 362/712] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:45.072457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:45.088246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:45.114742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:45.209529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3d9be-9a89-4abe-abe8-93ddb1bb3931 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:45.250825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:45.251838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.252328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.252837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.253887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=7949d9285d4e4c908c377a0ac16dd14d) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:45.254437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:45.256151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:45.270304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6ed7-a4e5-49d6-ba9c-6e10f7c1d5be None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:45.270696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 351/713] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:45 2022] GET /identity/v3/role_assignments?user.id=7949d9285d4e4c908c377a0ac16dd14d&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=b76f0bbd02794923b10af161becac1c6 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:45.272031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:45.348330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:45.350228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.351455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.352142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] PATH_INFO: `/v3/services/network` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.354313 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:45.356837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:45.385794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:45.388002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:45.388885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:45.399297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 363/714] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:45 2022] GET /identity/v3/services/network => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:45.401227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:45.482292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:45.533627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:45.552131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382c90-9f7e-4f46-87e2-8c3425862da7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:45.594590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:45.595255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.595544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.595815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.596418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:45.597838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:45.611292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:45.613194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:45.614898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 352/715] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Sep 1 08:02:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:45.623789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:45.654715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841d93d-b708-4784-99aa-328d352b5500 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:45.820452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25916a-f913-4989-ab76-0d81a29f3c29 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:45.907516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:45.908506 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.908959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.909395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.910470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] RBAC: Adding query filter params (name=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:45.910945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:45.913415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:45.922605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 364/716] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:45.932102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:45.932573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:45.932800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.933658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.933939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.934636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:45.934940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:45.936360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:45.956667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 353/717] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:45.962562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:46.016093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:46.100387 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:46.124049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3572e08-fe59-4f3a-acf3-ebe8ec639969 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:46.188495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d72a06-e6b4-41b5-b018-94306a9e3956 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:46.194539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925e0af-d81e-4bb3-82d2-67f2aed83865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:46.195824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e0af-d81e-4bb3-82d2-67f2aed83865 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.196388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e0af-d81e-4bb3-82d2-67f2aed83865 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.196956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925e0af-d81e-4bb3-82d2-67f2aed83865 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.198207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925e0af-d81e-4bb3-82d2-67f2aed83865 None admin] RBAC: Adding query filter params (type=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:46.199424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925e0af-d81e-4bb3-82d2-67f2aed83865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:46.202080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925e0af-d81e-4bb3-82d2-67f2aed83865 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:46.213063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 365/718] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:46.267697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851fe68-3549-469f-9412-4b2d5f80f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:46.268347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851fe68-3549-469f-9412-4b2d5f80f1ea None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.268708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851fe68-3549-469f-9412-4b2d5f80f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.268993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851fe68-3549-469f-9412-4b2d5f80f1ea None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.269658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851fe68-3549-469f-9412-4b2d5f80f1ea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:46.269968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851fe68-3549-469f-9412-4b2d5f80f1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:46.271419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851fe68-3549-469f-9412-4b2d5f80f1ea None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:46.286482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 354/719] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:47.143472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fb18-fb04-48bd-8796-dc3e91fd0bc0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.144040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fb18-fb04-48bd-8796-dc3e91fd0bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.144412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fb18-fb04-48bd-8796-dc3e91fd0bc0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.147252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 366/720] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:47.155454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe357bb-3a2a-4e4e-91ce-db75990ea5b7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.155975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe357bb-3a2a-4e4e-91ce-db75990ea5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.156371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe357bb-3a2a-4e4e-91ce-db75990ea5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.197645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-efe357bb-3a2a-4e4e-91ce-db75990ea5b7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:47.200222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-efe357bb-3a2a-4e4e-91ce-db75990ea5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:47.374425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 355/721] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:47.734952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fb18-fb04-48bd-8796-dc3e91fd0bc0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:47.773249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5add-ad57-4bf9-ab2b-4a0728932c30 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.774188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5add-ad57-4bf9-ab2b-4a0728932c30 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.774967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5add-ad57-4bf9-ab2b-4a0728932c30 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.780282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 356/722] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:47.782963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1dad3-6454-4a77-9323-0d867eb179e1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.783530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1dad3-6454-4a77-9323-0d867eb179e1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.784014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1dad3-6454-4a77-9323-0d867eb179e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.815712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-58a1dad3-6454-4a77-9323-0d867eb179e1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:47.817282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-58a1dad3-6454-4a77-9323-0d867eb179e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:47.840391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:47.948058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fb18-fb04-48bd-8796-dc3e91fd0bc0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.019362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce2ec7-3f54-4477-b7a8-81298051362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.020814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2ec7-3f54-4477-b7a8-81298051362a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.021512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2ec7-3f54-4477-b7a8-81298051362a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.022205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2ec7-3f54-4477-b7a8-81298051362a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.043708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce2ec7-3f54-4477-b7a8-81298051362a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-69ce2ec7-3f54-4477-b7a8-81298051362a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:48.054591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:48.056640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:48.059428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:48.060927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 357/723] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:48.063732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 367/724] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:48.084544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1dad3-6454-4a77-9323-0d867eb179e1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.178823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dbe81-c87b-41e6-82da-ed0f3c8c595a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.180303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dbe81-c87b-41e6-82da-ed0f3c8c595a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.181075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dbe81-c87b-41e6-82da-ed0f3c8c595a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.185204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 368/725] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:48.194163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3e079-0356-4b3c-a5b2-c0f7826c7be4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.195248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3e079-0356-4b3c-a5b2-c0f7826c7be4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.196001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3e079-0356-4b3c-a5b2-c0f7826c7be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.229176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bec3e079-0356-4b3c-a5b2-c0f7826c7be4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:48.232266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bec3e079-0356-4b3c-a5b2-c0f7826c7be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:48.267181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:48.375667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 369/726] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:48.420401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1dad3-6454-4a77-9323-0d867eb179e1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.518966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.519883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.520304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.520804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.521985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:48.522545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.525101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:48.543018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 358/727] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:48.556348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3e079-0356-4b3c-a5b2-c0f7826c7be4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.649244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.683529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:48.905989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3e079-0356-4b3c-a5b2-c0f7826c7be4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.009038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.010724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.010724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.011013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.027088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce34ed8-c712-4452-9df7-df80744421cf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.035730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.038438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.041628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:49.070186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:49.072358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:49.075041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:49.075041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:49.075041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:49.078354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 370/728] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 523 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:49.079571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.105637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd928-d42d-4af6-8cae-74871bbd6cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.107270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd928-d42d-4af6-8cae-74871bbd6cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.107987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd928-d42d-4af6-8cae-74871bbd6cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.108716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fd928-d42d-4af6-8cae-74871bbd6cd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.130112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fd928-d42d-4af6-8cae-74871bbd6cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b08fd928-d42d-4af6-8cae-74871bbd6cd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:49.141751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:49.143763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:49.145611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:49.149589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 359/729] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 502 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:49.151498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd928-d42d-4af6-8cae-74871bbd6cd8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.272185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.296099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9e3e-17a8-47bc-9181-8053d1ab75d3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.338606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fd928-d42d-4af6-8cae-74871bbd6cd8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.358958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4ab76-a12d-495c-9f46-27cfb1fb3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.360505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ab76-a12d-495c-9f46-27cfb1fb3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.361184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ab76-a12d-495c-9f46-27cfb1fb3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.361687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ab76-a12d-495c-9f46-27cfb1fb3ac6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.379890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4ab76-a12d-495c-9f46-27cfb1fb3ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1bf4ab76-a12d-495c-9f46-27cfb1fb3ac6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:49.388196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:49.389356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:49.390347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:49.391002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 371/730] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:49.394842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4ab76-a12d-495c-9f46-27cfb1fb3ac6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.397201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c4feb-a9d6-4c76-93aa-b96fa0346137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.398199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c4feb-a9d6-4c76-93aa-b96fa0346137 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.398748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c4feb-a9d6-4c76-93aa-b96fa0346137 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.399231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c4feb-a9d6-4c76-93aa-b96fa0346137 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.400896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c4feb-a9d6-4c76-93aa-b96fa0346137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:49.400896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c4feb-a9d6-4c76-93aa-b96fa0346137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.404737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c4feb-a9d6-4c76-93aa-b96fa0346137 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.433579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 360/731] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:49.435816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7e01-3e83-444b-b660-7bc51114970e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.436312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7e01-3e83-444b-b660-7bc51114970e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.436774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7e01-3e83-444b-b660-7bc51114970e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.439331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 361/732] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:49.440513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c7e01-3e83-444b-b660-7bc51114970e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.477802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.552587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4ab76-a12d-495c-9f46-27cfb1fb3ac6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.609991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c7e01-3e83-444b-b660-7bc51114970e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.611348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.612294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.613002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.613241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.615035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:49.615035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.617174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.633009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 372/733] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:49.634482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.667935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.680266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f9fc0-6914-45e2-86c0-54a68dc7d61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.680884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f9fc0-6914-45e2-86c0-54a68dc7d61c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.681348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f9fc0-6914-45e2-86c0-54a68dc7d61c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.681784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f9fc0-6914-45e2-86c0-54a68dc7d61c None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.682588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f9fc0-6914-45e2-86c0-54a68dc7d61c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:49.682953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f9fc0-6914-45e2-86c0-54a68dc7d61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.684410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f9fc0-6914-45e2-86c0-54a68dc7d61c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.693903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 362/734] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:49.695239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d3ede-1acc-4aeb-856a-39388413deb1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.695523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d3ede-1acc-4aeb-856a-39388413deb1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.695790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d3ede-1acc-4aeb-856a-39388413deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.718844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ce2d3ede-1acc-4aeb-856a-39388413deb1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:49.720100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ce2d3ede-1acc-4aeb-856a-39388413deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:49.797833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5abde-91df-4e56-a1f2-1dd91075c42a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.810155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 363/735] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:49.810993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d3ede-1acc-4aeb-856a-39388413deb1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.817713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.847531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcfdbb-1d38-425a-abf9-18bd582ce503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.848566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcfdbb-1d38-425a-abf9-18bd582ce503 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.849049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcfdbb-1d38-425a-abf9-18bd582ce503 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.849534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcfdbb-1d38-425a-abf9-18bd582ce503 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.866498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcfdbb-1d38-425a-abf9-18bd582ce503 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.869414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcfdbb-1d38-425a-abf9-18bd582ce503 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c1dcfdbb-1d38-425a-abf9-18bd582ce503 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:49.892763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:49.893877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:49.894883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 373/736] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:49.896900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7437-c248-498d-a654-4ef583c58b0c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.897370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7437-c248-498d-a654-4ef583c58b0c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.897851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7437-c248-498d-a654-4ef583c58b0c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.905878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 374/737] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:49.905878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7437-c248-498d-a654-4ef583c58b0c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.951090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d3ede-1acc-4aeb-856a-39388413deb1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.974736 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.991722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.992359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.992648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.992914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.005017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.006504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:50.023703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:50.024744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:50.025643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:50.025643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:50.025643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:50.028076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 364/738] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:50.029366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.083894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7437-c248-498d-a654-4ef583c58b0c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.125189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647c0a5-f04f-4be1-8359-e09e980237fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.125825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c0a5-f04f-4be1-8359-e09e980237fd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.126104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c0a5-f04f-4be1-8359-e09e980237fd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.126411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c0a5-f04f-4be1-8359-e09e980237fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.138085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647c0a5-f04f-4be1-8359-e09e980237fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.139749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647c0a5-f04f-4be1-8359-e09e980237fd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7647c0a5-f04f-4be1-8359-e09e980237fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:50.157161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:50.159163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:50.160932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:50.160932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:50.160932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:50.160932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 375/739] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:50.160932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413a2b-0483-4a78-b984-e49fb519d8b4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.160932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413a2b-0483-4a78-b984-e49fb519d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.160932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc413a2b-0483-4a78-b984-e49fb519d8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.172945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e7330-2fed-49bc-bc68-129fffbd8133 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.179671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fc413a2b-0483-4a78-b984-e49fb519d8b4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:50.180878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fc413a2b-0483-4a78-b984-e49fb519d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:50.206194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.210940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.211572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.211860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.212130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.212871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.213182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.214910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.234625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 365/740] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.235500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.257799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 376/741] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:50.263502 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc413a2b-0483-4a78-b984-e49fb519d8b4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.272760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.371779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9c368-af13-400f-9d62-fb081bb615d0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.410994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.411617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.411897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.412178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.412833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.413131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.414944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.429011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 366/742] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.430028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.459623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc413a2b-0483-4a78-b984-e49fb519d8b4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.520202 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea040-67e7-4b5c-b25e-464ea5f6137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.521256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea040-67e7-4b5c-b25e-464ea5f6137a None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.521696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea040-67e7-4b5c-b25e-464ea5f6137a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.522115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea040-67e7-4b5c-b25e-464ea5f6137a None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.523194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ea040-67e7-4b5c-b25e-464ea5f6137a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.525803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ea040-67e7-4b5c-b25e-464ea5f6137a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.552426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 377/743] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:02:50 2022] POST /identity/v3/services => generated 240 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:50.553962 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea040-67e7-4b5c-b25e-464ea5f6137a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.588015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.590664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.616095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a403f1-32a4-4f54-9a0e-8b02628dca02 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.670644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.671174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.671449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.671719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.672394 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.672727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.674141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.691475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 367/744] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.692933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.763450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea040-67e7-4b5c-b25e-464ea5f6137a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.812619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30334-8e05-455e-9c36-cd0f778ef38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.813570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30334-8e05-455e-9c36-cd0f778ef38f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.814069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30334-8e05-455e-9c36-cd0f778ef38f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.814612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a30334-8e05-455e-9c36-cd0f778ef38f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.871725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc2c8-0520-427f-b2f4-94c0a20b965f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.930225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a30334-8e05-455e-9c36-cd0f778ef38f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.932367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a30334-8e05-455e-9c36-cd0f778ef38f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.938908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.938908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.939352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.939352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.952006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.954196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:50.968768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:50.970763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 368/745] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:50.972644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.979311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.982925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:51.121940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 378/746] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:51.123576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30334-8e05-455e-9c36-cd0f778ef38f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:51.144063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76c13b-489e-4b00-bccd-08377ba2e366 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:51.190310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086ea97-2ec9-46b1-a9ff-1d48ff070ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:51.191064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ea97-2ec9-46b1-a9ff-1d48ff070ae9 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:51.191484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ea97-2ec9-46b1-a9ff-1d48ff070ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:51.191890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086ea97-2ec9-46b1-a9ff-1d48ff070ae9 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:51.192720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086ea97-2ec9-46b1-a9ff-1d48ff070ae9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:51.194389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086ea97-2ec9-46b1-a9ff-1d48ff070ae9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:51.218641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 369/747] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:02:50 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:51.220708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086ea97-2ec9-46b1-a9ff-1d48ff070ae9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:51.318152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a30334-8e05-455e-9c36-cd0f778ef38f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:51.356698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:51.359843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:51.418662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:51.419570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:51.419853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:51.420129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:51.434793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:51.437410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:51.445857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086ea97-2ec9-46b1-a9ff-1d48ff070ae9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:51.457949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:51.459739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:51.462054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:51.466867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 379/748] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:51.468435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:51.529431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:51.530939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:51.531749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:51.532231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:51.533807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:51.534691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:51.536373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:51.582833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 370/749] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:51.584436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:51.687074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0b372-1c53-469c-abd7-fcded92861cf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:51.756600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:51.758251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:51.759133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:51.759906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:51.781705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:51.785041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:51.794600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81692-e2d7-4ce9-b4dc-5617234f4593 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:51.814870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:51.815878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:51.816782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:51.816782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:51.816782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:51.820213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 380/750] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:51.828183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:51.845976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:51.873473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:51.874573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:51.875079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:51.875577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:51.877094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:51.877644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:51.880356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:51.889253 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:51.930591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 371/751] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:51.932240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.035702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8934be7-3dfd-4d33-9bd3-38e220fe2726 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:52.103231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a0384-b6d4-4124-888e-c702077fbbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:52.104537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a0384-b6d4-4124-888e-c702077fbbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.105837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a0384-b6d4-4124-888e-c702077fbbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.106582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a0384-b6d4-4124-888e-c702077fbbc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.147434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9531e-cd4c-40a3-a3bb-b399f297087c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:52.219089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:52.220222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.220783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.221490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.223352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:52.223576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:52.226301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:52.236932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a0384-b6d4-4124-888e-c702077fbbc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:52.240180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a0384-b6d4-4124-888e-c702077fbbc3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:52.258681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 372/752] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:52.259719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.296847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:52.351095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:52.437197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 381/753] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:02:52.439634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a0384-b6d4-4124-888e-c702077fbbc3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.476161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2896-b8af-4e7f-8733-04577c9d54c5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:52.544925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:52.546011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.546540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.547074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.569829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:52.572938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:52.602573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:52.604411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:52.607823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:52.607823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:52.607823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:52.610496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 373/754] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:52.612169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.645276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a0384-b6d4-4124-888e-c702077fbbc3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:52.697763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:52.716711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3635c0-0106-4d28-9121-8fc42955ae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:52.717323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3635c0-0106-4d28-9121-8fc42955ae7b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.717804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3635c0-0106-4d28-9121-8fc42955ae7b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.718381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3635c0-0106-4d28-9121-8fc42955ae7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.731594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3635c0-0106-4d28-9121-8fc42955ae7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:52.734350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3635c0-0106-4d28-9121-8fc42955ae7b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:52.737100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:52.749123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b7535-5baf-48c0-af12-868cf324d52d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-eb3635c0-0106-4d28-9121-8fc42955ae7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:52.762389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:52.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 382/755] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7299-adb7-4f9f-bfaf-f553d7f04c9e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.771505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7299-adb7-4f9f-bfaf-f553d7f04c9e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.777420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7299-adb7-4f9f-bfaf-f553d7f04c9e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.777420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 383/756] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:52.777420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df7299-adb7-4f9f-bfaf-f553d7f04c9e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.795610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d406a-11f0-44dd-a930-615d033f668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:52.796376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d406a-11f0-44dd-a930-615d033f668a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.796685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d406a-11f0-44dd-a930-615d033f668a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.797017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d406a-11f0-44dd-a930-615d033f668a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.812100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d406a-11f0-44dd-a930-615d033f668a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:52.813547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d406a-11f0-44dd-a930-615d033f668a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-893d406a-11f0-44dd-a930-615d033f668a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:52.829816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:52.831671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:52.833407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:52.833407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:52.833407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:52.833407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 374/757] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:52.833407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdee2-d71e-4ca9-aded-cf1420e43c8d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.833407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdee2-d71e-4ca9-aded-cf1420e43c8d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.833407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdee2-d71e-4ca9-aded-cf1420e43c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.854112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b5cbdee2-d71e-4ca9-aded-cf1420e43c8d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:52.856046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b5cbdee2-d71e-4ca9-aded-cf1420e43c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:52.952604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 375/758] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:52.959866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbdee2-d71e-4ca9-aded-cf1420e43c8d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.990160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df7299-adb7-4f9f-bfaf-f553d7f04c9e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.088873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.091134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.091766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.092352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.093712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:53.094416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.097075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.128364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 384/759] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:53.128364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.144429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:53.197886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbdee2-d71e-4ca9-aded-cf1420e43c8d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.222558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:53.269774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.271307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.272012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.272681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.274163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:53.274997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.278436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.310461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 376/760] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:53.312488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.324313 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb124d-cd2a-4710-bfc2-288dbd1524b2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.386429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.387552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.388123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.388683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.389887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:53.390558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.393273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.416436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 385/761] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:53.418615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.492041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161ed97-01e3-4788-b79b-70c966e26d85 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.535482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c688-8dfd-4bef-b89c-a117551331a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.536123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c688-8dfd-4bef-b89c-a117551331a6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.536407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c688-8dfd-4bef-b89c-a117551331a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.536673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c688-8dfd-4bef-b89c-a117551331a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.538965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:53.545310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c688-8dfd-4bef-b89c-a117551331a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.547018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c688-8dfd-4bef-b89c-a117551331a6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-4986c688-8dfd-4bef-b89c-a117551331a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:53.559908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:53.561057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:53.562157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:53.562157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:53.562157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:53.562157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:53.562157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:53.562157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:53.562157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:53.562157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:53.562926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e92419-fe06-4e21-bfe1-145004836555 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.566712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 377/762] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:53.569155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709e88-7859-4ac0-99bc-dbaa3cd72c03 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.569649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709e88-7859-4ac0-99bc-dbaa3cd72c03 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.570141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709e88-7859-4ac0-99bc-dbaa3cd72c03 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.572353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:53.573074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 378/763] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:53.575652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709e88-7859-4ac0-99bc-dbaa3cd72c03 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.602679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.603299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.603577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.603864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.604588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=57b1ae1f4f4e4f199a3798a4ff0b83c5) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:53.605437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.606977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.614503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 386/764] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/role_assignments?user.id=57b1ae1f4f4e4f199a3798a4ff0b83c5&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:53.615854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.766819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffd6fa-3c21-48fd-9e3b-a40f7ff86584 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.770810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709e88-7859-4ac0-99bc-dbaa3cd72c03 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.826246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981be927-f101-42fb-afe0-09764f532aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.827075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981be927-f101-42fb-afe0-09764f532aab None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.827507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981be927-f101-42fb-afe0-09764f532aab None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.827955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981be927-f101-42fb-afe0-09764f532aab None admin] PATH_INFO: `/v3/services/network` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.828793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981be927-f101-42fb-afe0-09764f532aab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.829174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cddbf-5c48-403d-9895-491014c44d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.829932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cddbf-5c48-403d-9895-491014c44d88 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.830203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cddbf-5c48-403d-9895-491014c44d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.830503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cddbf-5c48-403d-9895-491014c44d88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.831296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981be927-f101-42fb-afe0-09764f532aab None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.844479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cddbf-5c48-403d-9895-491014c44d88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.845940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cddbf-5c48-403d-9895-491014c44d88 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-981be927-f101-42fb-afe0-09764f532aab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:53.848638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:53.850564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:53.854179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 387/765] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:53.857696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981be927-f101-42fb-afe0-09764f532aab None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3f8cddbf-5c48-403d-9895-491014c44d88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:53.866439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:53.878351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 379/766] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9bc6-acd6-411e-b0f7-3ccca0ac873d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.880343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9bc6-acd6-411e-b0f7-3ccca0ac873d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.883448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9bc6-acd6-411e-b0f7-3ccca0ac873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.897922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-437b9bc6-acd6-411e-b0f7-3ccca0ac873d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:53.900030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-437b9bc6-acd6-411e-b0f7-3ccca0ac873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:53.921167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:53.997401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.027230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 380/767] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:54.028655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b9bc6-acd6-411e-b0f7-3ccca0ac873d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.029815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981be927-f101-42fb-afe0-09764f532aab None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.095568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.097078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.097590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.098198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.099127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.099553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.101406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.118773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 388/768] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:54.119787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.222021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b9bc6-acd6-411e-b0f7-3ccca0ac873d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.262962 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.268297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.269977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.271026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.271511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.272364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] RBAC: Adding query filter params (name=network) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.272828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.273969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065af15-0b6a-4eb7-8f03-2f8b8148a9d0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.274633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.281938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 381/769] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:54.283159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.329408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.330539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.332301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.332892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.334756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.335391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.338373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.362076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.367584 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 389/770] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:54.367584 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.435721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1bea7-7317-4ffd-8739-dbd7a68516af None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.503856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce79f75-f0f6-43d0-be0c-6a15c13c70bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.504963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce79f75-f0f6-43d0-be0c-6a15c13c70bf None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.505699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce79f75-f0f6-43d0-be0c-6a15c13c70bf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.505924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce79f75-f0f6-43d0-be0c-6a15c13c70bf None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/7949d9285d4e4c908c377a0ac16dd14d/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.509230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce79f75-f0f6-43d0-be0c-6a15c13c70bf None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=7949d9285d4e4c908c377a0ac16dd14d, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.512514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce79f75-f0f6-43d0-be0c-6a15c13c70bf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.534544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 382/771] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:54 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/7949d9285d4e4c908c377a0ac16dd14d/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:54.536177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce79f75-f0f6-43d0-be0c-6a15c13c70bf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.552528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9902e-c117-455f-b999-d53031349f89 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.627677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.629092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.629479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.629990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.631658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] RBAC: Adding query filter params (type=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.632030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.636677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.653230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 390/772] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:54.654950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.701008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.717996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce79f75-f0f6-43d0-be0c-6a15c13c70bf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.734119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.775223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.775881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.776165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.776445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.777433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.779702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:54.796403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:54.797441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:54.798354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:54.799116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 383/773] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:54.800807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.841147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3942e-9b72-4ea0-964f-718ee01c489f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.880639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.881266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.881551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.881826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.882606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=ef9aa824aafe4c499df84fa0c3fe3f42) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.882922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.884419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.898061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 391/774] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/role_assignments?user.id=ef9aa824aafe4c499df84fa0c3fe3f42&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=b76f0bbd02794923b10af161becac1c6 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:54.901200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.015194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4804-9855-493e-85de-6272219d2820 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.015951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:55.054001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb65d0-3336-439b-9131-8ef9fd0eb8a9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.061390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.062039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.062362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.062645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.063408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] RBAC: Adding query filter params (interface=public, service_id=45fb06dbde3b49db95d005618436f0bc, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:55.063726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.065279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.075557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 384/775] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/endpoints?service_id=45fb06dbde3b49db95d005618436f0bc&interface=public®ion_id=RegionOne => generated 194 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:55.085832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.103035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.103675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.103956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.104228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.105098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:55.105413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.111321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.125199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 392/776] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:55.133913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.163836 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:55.244897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de918a1-fb43-43dd-9ddd-1ef2ac2ab108 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.259776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7701-0038-43fd-ba7b-974cfca4cfe4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.284743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941ae25-ca57-407f-8662-8211262b163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.285371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ae25-ca57-407f-8662-8211262b163a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.285652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ae25-ca57-407f-8662-8211262b163a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.285924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941ae25-ca57-407f-8662-8211262b163a None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.286575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941ae25-ca57-407f-8662-8211262b163a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.287965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941ae25-ca57-407f-8662-8211262b163a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.294476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 385/777] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:02:55 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:55.307325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.308453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.308793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.309011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:55.309974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.311427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.317534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 393/778] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:55.324400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941ae25-ca57-407f-8662-8211262b163a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.474410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:55.478010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941ae25-ca57-407f-8662-8211262b163a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.541837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc46abd-19f8-48d3-adda-8ec962312868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.543096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46abd-19f8-48d3-adda-8ec962312868 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.543377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46abd-19f8-48d3-adda-8ec962312868 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.543651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46abd-19f8-48d3-adda-8ec962312868 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.544389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc46abd-19f8-48d3-adda-8ec962312868 None admin] RBAC: Adding query filter params (interface=public, service_id=a25467a6e77048e4b63e37234bcc41e8, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:55.544699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc46abd-19f8-48d3-adda-8ec962312868 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.546141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc46abd-19f8-48d3-adda-8ec962312868 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.556724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 386/779] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 08:02:55 2022] GET /identity/v3/endpoints?service_id=a25467a6e77048e4b63e37234bcc41e8&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:55.558295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.579107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:55.703799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d151f-f56e-40cc-a0a6-c16ad9a5d34b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.767368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab3a74-565e-44b2-9dd2-b5e3a29825e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.768907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3a74-565e-44b2-9dd2-b5e3a29825e0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.769722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3a74-565e-44b2-9dd2-b5e3a29825e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.770538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab3a74-565e-44b2-9dd2-b5e3a29825e0 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.771947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab3a74-565e-44b2-9dd2-b5e3a29825e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.775018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab3a74-565e-44b2-9dd2-b5e3a29825e0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.787082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 394/780] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:02:55 2022] GET /identity/v3/services => generated 772 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:56.456100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599860b-09f5-4c06-b11d-922c8fcd8a12 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:56.456890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599860b-09f5-4c06-b11d-922c8fcd8a12 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:56.457234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599860b-09f5-4c06-b11d-922c8fcd8a12 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:56.459980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 387/781] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:56.469922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f185bd-bbba-4dd8-9491-3dbae3f5ffa4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:56.470726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f185bd-bbba-4dd8-9491-3dbae3f5ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:56.471037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f185bd-bbba-4dd8-9491-3dbae3f5ffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:56.510212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c7f185bd-bbba-4dd8-9491-3dbae3f5ffa4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:56.512835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c7f185bd-bbba-4dd8-9491-3dbae3f5ffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:56.687410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 395/782] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:57.181192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599860b-09f5-4c06-b11d-922c8fcd8a12 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:57.408975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599860b-09f5-4c06-b11d-922c8fcd8a12 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:57.492109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5a5c-f79c-426d-b1fe-c64b40f84fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:57.493182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5a5c-f79c-426d-b1fe-c64b40f84fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:57.493928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5a5c-f79c-426d-b1fe-c64b40f84fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:57.494469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5a5c-f79c-426d-b1fe-c64b40f84fe9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:57.516319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c5a5c-f79c-426d-b1fe-c64b40f84fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-917c5a5c-f79c-426d-b1fe-c64b40f84fe9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:57.525688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:57.527235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:57.528503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:57.529161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 388/783] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:57.536559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f185bd-bbba-4dd8-9491-3dbae3f5ffa4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:57.548306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:57.587145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405974-25f1-4603-8d7d-89b059fc3413 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:57.587643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405974-25f1-4603-8d7d-89b059fc3413 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:57.588127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405974-25f1-4603-8d7d-89b059fc3413 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:57.591755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 389/784] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:57.600417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0471-df15-4c53-afe5-852376deaac9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:57.600915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0471-df15-4c53-afe5-852376deaac9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:57.601401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a0471-df15-4c53-afe5-852376deaac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:57.635677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-899a0471-df15-4c53-afe5-852376deaac9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:57.637808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-899a0471-df15-4c53-afe5-852376deaac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:57.699477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:57.703624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f185bd-bbba-4dd8-9491-3dbae3f5ffa4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:57.744509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:57.745042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:57.745890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:57.746379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:57.747187 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:57.747500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:57.748904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:57.758300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 396/785] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:57.764994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:57.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:57.842856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 390/786] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:02:57.878879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a751b6-26dc-4219-8f44-3ad5384890e0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:57.917836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6d37a-b4d5-4977-935b-b42f973012c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:57.918851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d37a-b4d5-4977-935b-b42f973012c3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:57.919141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d37a-b4d5-4977-935b-b42f973012c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:57.919434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d37a-b4d5-4977-935b-b42f973012c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:57.931060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6d37a-b4d5-4977-935b-b42f973012c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:57.932565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6d37a-b4d5-4977-935b-b42f973012c3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6ca6d37a-b4d5-4977-935b-b42f973012c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:57.949558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:57.951517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:57.953337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:57.953337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:57.953337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:57.953337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 397/787] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:57.956808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a0471-df15-4c53-afe5-852376deaac9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:58.024414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0745-d171-4de2-ba2c-8381547e472d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.025326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0745-d171-4de2-ba2c-8381547e472d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.026147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0745-d171-4de2-ba2c-8381547e472d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.034298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 398/788] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:02:58.042086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab252f-6f48-4688-84b3-3bfed9a25670 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.043090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab252f-6f48-4688-84b3-3bfed9a25670 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.043890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab252f-6f48-4688-84b3-3bfed9a25670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.113675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dbab252f-6f48-4688-84b3-3bfed9a25670 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:58.117793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dbab252f-6f48-4688-84b3-3bfed9a25670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:58.148980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a0471-df15-4c53-afe5-852376deaac9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:58.187747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9036d2-811d-4ddd-b5b2-ced2e1e518d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:58.188362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9036d2-811d-4ddd-b5b2-ced2e1e518d7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.188639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9036d2-811d-4ddd-b5b2-ced2e1e518d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.188910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9036d2-811d-4ddd-b5b2-ced2e1e518d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.189558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9036d2-811d-4ddd-b5b2-ced2e1e518d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:58.189862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9036d2-811d-4ddd-b5b2-ced2e1e518d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:58.191264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9036d2-811d-4ddd-b5b2-ced2e1e518d7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:58.203916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 391/789] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:58.205277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b444f-e505-4b2c-828b-70bfe36ace31 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.205649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b444f-e505-4b2c-828b-70bfe36ace31 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.205928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b444f-e505-4b2c-828b-70bfe36ace31 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.207511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 392/790] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:58.213164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b444f-e505-4b2c-828b-70bfe36ace31 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:58.233894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:58.272419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 399/791] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:58.274018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee723-6743-40b0-8a31-720969ad3e42 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.274336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee723-6743-40b0-8a31-720969ad3e42 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.274821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee723-6743-40b0-8a31-720969ad3e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.294710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-494ee723-6743-40b0-8a31-720969ad3e42 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:58.296044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-494ee723-6743-40b0-8a31-720969ad3e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:58.335951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b444f-e505-4b2c-828b-70bfe36ace31 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:58.362494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:58.414157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 400/792] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:58.421969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee723-6743-40b0-8a31-720969ad3e42 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:58.426825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:58.428155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.428852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.429537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.445972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:58.449737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:58.479415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:58.481517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:58.482524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:58.487239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 393/793] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:02:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:58.494004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:58.646906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee723-6743-40b0-8a31-720969ad3e42 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:58.687023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:58.694534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a9019-6dac-4477-9ad0-b4df117762f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:58.695617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a9019-6dac-4477-9ad0-b4df117762f7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.696002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a9019-6dac-4477-9ad0-b4df117762f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.696384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a9019-6dac-4477-9ad0-b4df117762f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.710151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a9019-6dac-4477-9ad0-b4df117762f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f81a9019-6dac-4477-9ad0-b4df117762f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:58.718126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:58.719182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:58.720029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:58.720683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 401/794] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:58.721986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a9019-6dac-4477-9ad0-b4df117762f7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:58.741233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087b01b-f354-4521-8c6c-9f8da8352790 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:58.781631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:58.786024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:58.786666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.786950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.787268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.788162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:58.788407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:58.789869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:58.813924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 394/795] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 08:02:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:58.814895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:58.899744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a9019-6dac-4477-9ad0-b4df117762f7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:58.957207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ad96e-64ff-4c22-9fd6-063094ed6241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:58.957631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf751-d8e2-4d88-b34a-159be8878bee None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:58.958179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad96e-64ff-4c22-9fd6-063094ed6241 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.958688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad96e-64ff-4c22-9fd6-063094ed6241 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.959134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ad96e-64ff-4c22-9fd6-063094ed6241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.977622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ad96e-64ff-4c22-9fd6-063094ed6241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e59ad96e-64ff-4c22-9fd6-063094ed6241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:58.986630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:58.987669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:58.988535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 402/796] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:58.989271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ad96e-64ff-4c22-9fd6-063094ed6241 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.018969 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.027155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93651312-4271-497f-8b74-477c065d53cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.028117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93651312-4271-497f-8b74-477c065d53cb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.028544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93651312-4271-497f-8b74-477c065d53cb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.028953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93651312-4271-497f-8b74-477c065d53cb None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.030095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93651312-4271-497f-8b74-477c065d53cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:59.030646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93651312-4271-497f-8b74-477c065d53cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.033038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93651312-4271-497f-8b74-477c065d53cb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.046781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 395/797] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:59.051609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93651312-4271-497f-8b74-477c065d53cb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.139713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.145922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ad96e-64ff-4c22-9fd6-063094ed6241 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.195414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93651312-4271-497f-8b74-477c065d53cb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.199444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.200090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.200372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.200649 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] PATH_INFO: `/v3/services/network` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.201245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.202656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:59.213617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:59.215349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:59.216189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:59.220550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 403/798] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:58 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:59.221292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.233309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.234054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.234365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.234634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.246572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.248093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:59.263667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:59.265446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:59.267314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:59.267314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:59.267314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:59.267314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 396/799] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:59.267314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.326007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.352089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1c493-d557-4ee5-b668-c651a79d2250 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.391553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3294d-08a9-41d0-a7c8-d56ce1bb41ad None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.403838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d2b8e-3829-4432-bafe-41ee8e2a76a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.404487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2b8e-3829-4432-bafe-41ee8e2a76a4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.404767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2b8e-3829-4432-bafe-41ee8e2a76a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.405033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2b8e-3829-4432-bafe-41ee8e2a76a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.405755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d2b8e-3829-4432-bafe-41ee8e2a76a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:59.406056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d2b8e-3829-4432-bafe-41ee8e2a76a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.407463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d2b8e-3829-4432-bafe-41ee8e2a76a4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.418170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 404/800] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:59.419265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09164e8d-9119-4180-a187-dacd87bd6ea9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.419625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09164e8d-9119-4180-a187-dacd87bd6ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.419820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09164e8d-9119-4180-a187-dacd87bd6ea9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.421103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 405/801] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:59.421103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09164e8d-9119-4180-a187-dacd87bd6ea9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.435183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.435836 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.436123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.436403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.451149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.456382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.457684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:59.478555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:59.479899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:59.481219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:59.481219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:59.481219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:02:59.481219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 397/802] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:59.481219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.545655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09164e8d-9119-4180-a187-dacd87bd6ea9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.582671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.583293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.583574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.583850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.584489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] RBAC: Adding query filter params (name=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:59.584798 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.586225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.592399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 406/803] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:59.593250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.616107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.622080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0f9a3-67d3-40dc-8059-8e15e39e31f6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.674065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaeb10-99c4-4be0-b01e-1b90be7b7c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.674991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaeb10-99c4-4be0-b01e-1b90be7b7c50 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.675323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaeb10-99c4-4be0-b01e-1b90be7b7c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.675641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaeb10-99c4-4be0-b01e-1b90be7b7c50 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.676451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaeb10-99c4-4be0-b01e-1b90be7b7c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:59.676810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaeb10-99c4-4be0-b01e-1b90be7b7c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.678428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaeb10-99c4-4be0-b01e-1b90be7b7c50 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.692950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 398/804] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:59.695124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619602b-d478-4c6b-aac3-a16d5cf5cd71 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.695601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619602b-d478-4c6b-aac3-a16d5cf5cd71 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.696076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619602b-d478-4c6b-aac3-a16d5cf5cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.719500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6619602b-d478-4c6b-aac3-a16d5cf5cd71 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:59.721481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6619602b-d478-4c6b-aac3-a16d5cf5cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:59.725619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.747134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6bef-ebb9-4743-b33d-36bd79a707eb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.788366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.789023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.789304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.789575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.801788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.803354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:59.820716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:59.822668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:59.825412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:59.825412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:59.825412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:02:59.825412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 407/805] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:59.825412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.843864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 399/806] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:59.843864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619602b-d478-4c6b-aac3-a16d5cf5cd71 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.971173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d613c-1cf5-4d56-8220-d08e099b0bc2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.976096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.992600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619602b-d478-4c6b-aac3-a16d5cf5cd71 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.036336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.036975 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.037262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.037593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.038280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.038706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.039508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.040158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.040505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.041014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.041525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.043355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] RBAC: Adding query filter params (type=network) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.043919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.046999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.051871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.061605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 408/807] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:00.061605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.072247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 400/808] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:00.072247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.193603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b915ed1-0d9e-4318-9b19-f956a4a68b52 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.233315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.233595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.233867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.244940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.247089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238ef02-3f3d-4ea1-bb1d-f8c7872e8a64 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.247776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:00.268018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:00.269129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 409/809] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:00.270125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.300987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.302034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.302594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.303131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.304290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.304825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.307445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.334635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 401/810] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:00.334635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.339157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.348288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.385672 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019288e-7223-446b-bd2f-350e8fea06fc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.430014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.430720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.431037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.431338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.441355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.443066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.456551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f41d94-cf61-4a31-bbad-730b7f9fbd94 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:00.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:00.461603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 410/811] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:00.464734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.512013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf34ee5-bcab-4d13-8423-e6bc99d937cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.512686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf34ee5-bcab-4d13-8423-e6bc99d937cc None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.513055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf34ee5-bcab-4d13-8423-e6bc99d937cc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.513424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf34ee5-bcab-4d13-8423-e6bc99d937cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.514215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf34ee5-bcab-4d13-8423-e6bc99d937cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.515878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf34ee5-bcab-4d13-8423-e6bc99d937cc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.543922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 402/812] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:00.545054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf34ee5-bcab-4d13-8423-e6bc99d937cc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.641043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c11a57-8ecb-4a34-9497-5a2245cd5c2d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.669453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.682157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.717777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.718468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.718751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.719025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.719624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.721806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:00.731276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:00.733794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:00.735451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 411/813] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:00.738596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.743807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf34ee5-bcab-4d13-8423-e6bc99d937cc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.808425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.809859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.810411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.810897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.812287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.812837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.815924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.846787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 403/814] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:00.846787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.888948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9595a-db0d-421b-8f7d-168548bf22c0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.933811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.934623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.934908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.935187 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.944121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.945694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:00.960964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:00.962576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 412/815] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:00.964941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.992418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ec91-f663-4589-a4aa-4bed81ef4331 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.009787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.033134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.043910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.044832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.045288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.045749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.046622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:01.046984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.048510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.068791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 404/816] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:01.069288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.086585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27e04-e275-47cb-883c-cf7f6b147be4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.147109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.148148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.148627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.149121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.150314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:01.150863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.154909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.163323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 413/817] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:01.164797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.186041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3dc6c-a8e6-4f73-b183-dc2ab14f79ed None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.231763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ebd82-fc38-4a09-82c2-fa3cd55f8f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.232423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ebd82-fc38-4a09-82c2-fa3cd55f8f94 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.232700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ebd82-fc38-4a09-82c2-fa3cd55f8f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.232972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ebd82-fc38-4a09-82c2-fa3cd55f8f94 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/57b1ae1f4f4e4f199a3798a4ff0b83c5/roles/e9ad041f2bf540a9a37d7672449d853f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.249888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ebd82-fc38-4a09-82c2-fa3cd55f8f94 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=57b1ae1f4f4e4f199a3798a4ff0b83c5, role_id=e9ad041f2bf540a9a37d7672449d853f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.251402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ebd82-fc38-4a09-82c2-fa3cd55f8f94 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.267605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 405/818] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:01 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/57b1ae1f4f4e4f199a3798a4ff0b83c5/roles/e9ad041f2bf540a9a37d7672449d853f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:03:01.268998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ebd82-fc38-4a09-82c2-fa3cd55f8f94 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.305961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2133-d75c-46de-805e-e5f94eb6616e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.309858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.331630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.357180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.357835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.358117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.358589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.359497 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:01.359806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.361528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.394488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 414/819] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:01.395525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.465772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ebd82-fc38-4a09-82c2-fa3cd55f8f94 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.521586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec4340-0915-4ad9-9214-542d45e84146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.522209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4340-0915-4ad9-9214-542d45e84146 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.522519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4340-0915-4ad9-9214-542d45e84146 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.522790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4340-0915-4ad9-9214-542d45e84146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.546435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fff44-e6b3-4c81-92e3-45305f25ced6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.587318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.587840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.588132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.588415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.589129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:01.589965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.591405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.597309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 415/820] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:01.602690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.616903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec4340-0915-4ad9-9214-542d45e84146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.618718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec4340-0915-4ad9-9214-542d45e84146 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.649800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.660643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.740554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751595a-a223-44f5-b1d8-1cec20208092 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.769509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 406/821] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:01.772023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec4340-0915-4ad9-9214-542d45e84146 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.787254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.787906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.788191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.788469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.801548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.803243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:01.819595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:01.820634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:01.821536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:01.821536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:01.821536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:01.821536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 416/822] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:01.821761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.918234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec4340-0915-4ad9-9214-542d45e84146 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.926903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.969728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76655df-173d-48b2-bf64-f08694cda972 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.973660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9196f03-5e68-4d61-952a-9496688b7899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.974292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9196f03-5e68-4d61-952a-9496688b7899 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.974589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9196f03-5e68-4d61-952a-9496688b7899 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.974860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9196f03-5e68-4d61-952a-9496688b7899 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.975545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9196f03-5e68-4d61-952a-9496688b7899 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.976923 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9196f03-5e68-4d61-952a-9496688b7899 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.986840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:02.026575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 407/823] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:02.027517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.028022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9196f03-5e68-4d61-952a-9496688b7899 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.028297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.028642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.028818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.043587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.045186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:02.075953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:02.077821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:02.079678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:02.079678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:02.079678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:02.084629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 417/824] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:02.091111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.259180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9196f03-5e68-4d61-952a-9496688b7899 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.283906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639254b2-a8e8-48de-873a-a2476dc35019 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.318046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.319493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.320243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.321026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.322605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:02.323928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.326632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.333451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:02.350200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.351237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.351704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.352178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.353273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:02.353766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.355628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 408/825] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:02.361438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.363338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.389319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 418/826] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:02.396896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.540894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493b0d-34ca-4b00-9958-2effad221cb9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.593165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.594293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.594827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.595316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.605324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.607946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:02.627484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:02.628619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:02.629537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:02.629537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:02.629537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:02.629537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:02.629537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:02.629537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:02.629537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:02.629537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:02.636899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 419/827] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:02.638312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.644151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:02.716862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1015-f86d-42e9-88d8-e76c0cf46513 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.722071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:02.775666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.777726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.778440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.778956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.791691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.795259 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.811932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381d3cc-3f2e-4a5f-983d-8b6a085b6969 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:02.813251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:02.814781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:02.816381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:02.816381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:02.816381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:02.816381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:02.816381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:02.816381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:02.816381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:02.816381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:02.819481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 409/828] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:02.830326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.865525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.866373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.866665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.867438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.868958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:02.869498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.872102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.890693 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 420/829] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:02.898325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.983106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8ea36-4982-43e2-a888-1c7ef7bfb4af None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:03.000223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:03.017935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc639b-d4b7-467c-8dbb-187af0e6e037 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:03.027655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:03.028216 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:03.029678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.030122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.030619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.031613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:03.033494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:03.034209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:03.050505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 410/830] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:03.059811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:03.063827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2cd33-26ea-46e5-a10f-8003635f7083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:03.064878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2cd33-26ea-46e5-a10f-8003635f7083 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.065361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2cd33-26ea-46e5-a10f-8003635f7083 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.065855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2cd33-26ea-46e5-a10f-8003635f7083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.067253 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2cd33-26ea-46e5-a10f-8003635f7083 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=7949d9285d4e4c908c377a0ac16dd14d) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:03.068011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2cd33-26ea-46e5-a10f-8003635f7083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:03.070780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2cd33-26ea-46e5-a10f-8003635f7083 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:03.083033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 421/831] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/role_assignments?user.id=7949d9285d4e4c908c377a0ac16dd14d&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=b76f0bbd02794923b10af161becac1c6 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:03.236146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad542f5-c790-4dfe-977a-485b4142530d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:03.281649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd6a1b-2ebe-49ac-a003-0d3f5f82e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:03.282390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6a1b-2ebe-49ac-a003-0d3f5f82e435 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.282674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6a1b-2ebe-49ac-a003-0d3f5f82e435 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.282955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6a1b-2ebe-49ac-a003-0d3f5f82e435 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/ef9aa824aafe4c499df84fa0c3fe3f42/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.285160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd6a1b-2ebe-49ac-a003-0d3f5f82e435 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=ef9aa824aafe4c499df84fa0c3fe3f42, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:03.286721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd6a1b-2ebe-49ac-a003-0d3f5f82e435 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:03.303900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 411/832] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:03 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/ef9aa824aafe4c499df84fa0c3fe3f42/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:03:03.945217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69233ff8-cb4a-4eb0-84bc-68dcc1f7932d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.946200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69233ff8-cb4a-4eb0-84bc-68dcc1f7932d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.946724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69233ff8-cb4a-4eb0-84bc-68dcc1f7932d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.948593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 422/833] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:03.954553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3793-15c4-4184-99a0-374e62a8b587 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.955490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3793-15c4-4184-99a0-374e62a8b587 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.955975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3793-15c4-4184-99a0-374e62a8b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.983637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8e4c3793-15c4-4184-99a0-374e62a8b587 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:03.985686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8e4c3793-15c4-4184-99a0-374e62a8b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:04.036031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:04.107774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 412/834] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:04.380233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69233ff8-cb4a-4eb0-84bc-68dcc1f7932d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:04.405118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e06ecd-6294-44af-ab24-ff413b2a18d0 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:04.405494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e06ecd-6294-44af-ab24-ff413b2a18d0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:04.405779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e06ecd-6294-44af-ab24-ff413b2a18d0 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:04.407453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 413/835] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:04.413143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5c286-0af2-46e4-ba57-8b5e8637a66e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:04.415124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5c286-0af2-46e4-ba57-8b5e8637a66e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:04.415410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5c286-0af2-46e4-ba57-8b5e8637a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:04.442244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bae5c286-0af2-46e4-ba57-8b5e8637a66e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:04.444945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bae5c286-0af2-46e4-ba57-8b5e8637a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:04.539074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 414/836] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:04.558146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69233ff8-cb4a-4eb0-84bc-68dcc1f7932d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:04.618752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b1cb2-68d2-41ee-80fc-fa8f161406b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:04.620211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b1cb2-68d2-41ee-80fc-fa8f161406b5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:04.620988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b1cb2-68d2-41ee-80fc-fa8f161406b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:04.621677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b1cb2-68d2-41ee-80fc-fa8f161406b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:04.642695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b1cb2-68d2-41ee-80fc-fa8f161406b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-757b1cb2-68d2-41ee-80fc-fa8f161406b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:04.652762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:04.654472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:03:04.656416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:04.660162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 423/837] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:03:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:04.669807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5c286-0af2-46e4-ba57-8b5e8637a66e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:04.841346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b1cb2-68d2-41ee-80fc-fa8f161406b5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:04.845782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:04.864311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5c286-0af2-46e4-ba57-8b5e8637a66e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:04.903053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:04.935500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:04.936790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:04.937559 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:04.938226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:04.939835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:04.940548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:04.943230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:04.959766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 415/838] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:03:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:04.967983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:05.054973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b1cb2-68d2-41ee-80fc-fa8f161406b5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:05.123596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:05.124593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.125533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.126011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.127047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:05.129804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:05.148598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:05.150578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:05.154000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:05.159325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 424/839] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:05.164801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:05.167010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61a237-1505-4797-81f3-3baa38b0c852 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:05.257311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:05.259036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.259322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.259595 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.289840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:05.290651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c6645-23f8-4491-87ae-53e0b6351bdf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:05.295018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:05.295558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:05.333122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:05.335327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:05.337393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:05.337393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:05.337393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:05.342936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 416/840] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:05.343570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643858cc-893c-4329-a144-73af15b09887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:05.344595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643858cc-893c-4329-a144-73af15b09887 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.344977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643858cc-893c-4329-a144-73af15b09887 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.345486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643858cc-893c-4329-a144-73af15b09887 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.345916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:05.346361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643858cc-893c-4329-a144-73af15b09887 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:05.346928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643858cc-893c-4329-a144-73af15b09887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:05.348483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643858cc-893c-4329-a144-73af15b09887 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:05.359864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 425/841] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:05.361171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643858cc-893c-4329-a144-73af15b09887 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:05.365238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:05.538103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643858cc-893c-4329-a144-73af15b09887 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:05.541269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c748-c5b7-467b-ad32-17b054ef85fc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:05.586617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4f4af-27f1-4eb3-817a-a6e1a8b1c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:05.587637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f4af-27f1-4eb3-817a-a6e1a8b1c691 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.588120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f4af-27f1-4eb3-817a-a6e1a8b1c691 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.588583 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f4af-27f1-4eb3-817a-a6e1a8b1c691 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.589853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4f4af-27f1-4eb3-817a-a6e1a8b1c691 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:05.590309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4f4af-27f1-4eb3-817a-a6e1a8b1c691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:05.591134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:05.591980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.592464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.592853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4f4af-27f1-4eb3-817a-a6e1a8b1c691 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:05.593161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.594021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:05.594557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:05.596857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:05.601156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 426/842] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:05.603335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557677f9-9b86-449b-b579-c3aa009882d0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.603827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557677f9-9b86-449b-b579-c3aa009882d0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.604306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557677f9-9b86-449b-b579-c3aa009882d0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.610311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 427/843] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:05.616953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32f89-ab3e-4516-80ac-67e993fdc813 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.617772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32f89-ab3e-4516-80ac-67e993fdc813 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.618771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32f89-ab3e-4516-80ac-67e993fdc813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.622586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 417/844] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:05.630793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:05.658065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6ec32f89-ab3e-4516-80ac-67e993fdc813 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:05.659762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6ec32f89-ab3e-4516-80ac-67e993fdc813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:05.682756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:05.760433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:05.786289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 428/845] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:05.824895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149716e8-7baa-465d-9cbc-8629a4b5d886 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:05.872854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5965a-3cf5-4a70-a24a-2ad665192284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:05.873530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5965a-3cf5-4a70-a24a-2ad665192284 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.873852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5965a-3cf5-4a70-a24a-2ad665192284 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.874133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5965a-3cf5-4a70-a24a-2ad665192284 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.884298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5965a-3cf5-4a70-a24a-2ad665192284 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:05.886827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5965a-3cf5-4a70-a24a-2ad665192284 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-04f5965a-3cf5-4a70-a24a-2ad665192284 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:05.903526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:05.905407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:05.907330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 418/846] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:03:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:05.911656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec32f89-ab3e-4516-80ac-67e993fdc813 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.038758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec32f89-ab3e-4516-80ac-67e993fdc813 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.039338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775423-feb7-49d7-86a8-a279812884ae None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.039846 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775423-feb7-49d7-86a8-a279812884ae None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.040020 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775423-feb7-49d7-86a8-a279812884ae None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.043056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 419/847] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:06.047510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952ee4f-c34c-49fe-9e15-c375e043a7af None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.047868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952ee4f-c34c-49fe-9e15-c375e043a7af None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.048242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952ee4f-c34c-49fe-9e15-c375e043a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.072958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0952ee4f-c34c-49fe-9e15-c375e043a7af None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:06.074385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0952ee4f-c34c-49fe-9e15-c375e043a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:06.101733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.102800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.103314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.103829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.105766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:06.106365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.108995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.144156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 429/848] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 08:03:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:06.145500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.164628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.193212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 420/849] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:06.193212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952ee4f-c34c-49fe-9e15-c375e043a7af None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.289112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.306901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569e74-3e0d-43d8-b1b9-75ffa6b17472 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.355136 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.356241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.356592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.356959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.357917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.360421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:06.372453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:06.373660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:06.374641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:06.378351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952ee4f-c34c-49fe-9e15-c375e043a7af None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.379624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 430/850] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:06.380580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.445636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9ee38-b762-4646-8104-367975add96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.447154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9ee38-b762-4646-8104-367975add96c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.447601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9ee38-b762-4646-8104-367975add96c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.448044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9ee38-b762-4646-8104-367975add96c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.508712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.552131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eee2c8-f215-48d6-b1d0-fd7dbb84ec10 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.552847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9ee38-b762-4646-8104-367975add96c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.555408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9ee38-b762-4646-8104-367975add96c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.597900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.598829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.599275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.599584 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.600194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:06.600500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.601892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.615834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 431/851] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:06.615834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.640322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.697864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 421/852] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:06.698870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9ee38-b762-4646-8104-367975add96c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.766989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f34f15-fc53-4364-93b6-a87bc020676b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.830185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9ee38-b762-4646-8104-367975add96c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.832099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4210-f25f-4a07-9c66-55e4b579c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.833134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4210-f25f-4a07-9c66-55e4b579c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.833583 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4210-f25f-4a07-9c66-55e4b579c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.834957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4210-f25f-4a07-9c66-55e4b579c5a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.844307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.853184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4210-f25f-4a07-9c66-55e4b579c5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d99b4210-f25f-4a07-9c66-55e4b579c5a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:06.860350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:06.861528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 432/853] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:06.863078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4210-f25f-4a07-9c66-55e4b579c5a8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.878940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.879561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.879842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.880114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.880827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:06.881141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.882578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.888373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 422/854] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:06.897434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.944392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.017006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4210-f25f-4a07-9c66-55e4b579c5a8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.052776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b71505-2c95-4dbd-8792-a8868a133f8c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.071652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.072532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.073148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.074283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.090638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.092810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:07.109777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:07.112667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:07.114728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:07.114728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:07.114728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:07.114728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 433/855] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:07.116687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.138047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.140103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.141233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.141915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.143783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.145127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.148055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.172891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 423/856] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:07.184702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.202189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.277383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb424-8f1c-4f72-bc13-55bde5b416b3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.316400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.317481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.318385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.318385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.318685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.319254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.319559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.321016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.335828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 434/857] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:07.342517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.348987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9eb36-850e-4705-87c3-f2e7e0db62e8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.388785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.389809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.390871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.405628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.407593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:07.429479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:07.431567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:07.432904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:07.432904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:07.432904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:07.432904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 424/858] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:07.445037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.518639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b95f9-0167-4775-a761-2f8eb029c07a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.535878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.565276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.565597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.565739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.566094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.574492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.576660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:07.589812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:07.591767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:07.593255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:07.593255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:07.593255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:07.593255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:07.593255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:07.593255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:07.593255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:07.593255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:07.595712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 435/859] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:07.597110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.625024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94bebb-0786-486a-921e-01a613e5ebe1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.662032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.662984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.663438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.663885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.664732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.665223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.666819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.668701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.685992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 425/860] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:07.687316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.720415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7132ce-be8f-4d19-a3ab-d266c52a6877 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.760896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.761644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.761996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.762397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.763186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.763567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.765244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.784620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 436/861] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:07.786158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.804202 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802bf21-d470-4c50-ae7b-822a43cd27e5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.822608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.851104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ffe5a-bd3a-45b4-8847-8146c4f1ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.851837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffe5a-bd3a-45b4-8847-8146c4f1ad07 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.852135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffe5a-bd3a-45b4-8847-8146c4f1ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.852566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ffe5a-bd3a-45b4-8847-8146c4f1ad07 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.863619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ffe5a-bd3a-45b4-8847-8146c4f1ad07 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.866030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ffe5a-bd3a-45b4-8847-8146c4f1ad07 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-963ffe5a-bd3a-45b4-8847-8146c4f1ad07 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:07.881255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:07.882399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:07.883348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 426/862] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:07.884121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c04e-823b-4d59-a404-4128e8916f26 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.884408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c04e-823b-4d59-a404-4128e8916f26 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.884684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702c04e-823b-4d59-a404-4128e8916f26 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.886300 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 427/863] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:07.891069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702c04e-823b-4d59-a404-4128e8916f26 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.918384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de341ddc-ef7a-46e4-99ff-987f2485e2e7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.960198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532aaba-1ba7-4cd3-add3-30903305cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.960833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532aaba-1ba7-4cd3-add3-30903305cb9d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.961119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532aaba-1ba7-4cd3-add3-30903305cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.961406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532aaba-1ba7-4cd3-add3-30903305cb9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.962121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532aaba-1ba7-4cd3-add3-30903305cb9d None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=57b1ae1f4f4e4f199a3798a4ff0b83c5) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.962465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532aaba-1ba7-4cd3-add3-30903305cb9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.964691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532aaba-1ba7-4cd3-add3-30903305cb9d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.978321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 437/864] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/role_assignments?user.id=57b1ae1f4f4e4f199a3798a4ff0b83c5&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:07.978321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166aa1-ea9e-4446-86c6-8aa14b900360 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.978321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166aa1-ea9e-4446-86c6-8aa14b900360 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.978321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12166aa1-ea9e-4446-86c6-8aa14b900360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.996741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-12166aa1-ea9e-4446-86c6-8aa14b900360 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:07.998131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-12166aa1-ea9e-4446-86c6-8aa14b900360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:08.047845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702c04e-823b-4d59-a404-4128e8916f26 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.106948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 438/865] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:08.119366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.120134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.126291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.126291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.126291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:08.126291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.126291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.148688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 428/866] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:08.156186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12166aa1-ea9e-4446-86c6-8aa14b900360 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.201773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:08.310732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12166aa1-ea9e-4446-86c6-8aa14b900360 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.375005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074ce9-67af-4c95-80a9-31383c4ea5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.375615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074ce9-67af-4c95-80a9-31383c4ea5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.375899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074ce9-67af-4c95-80a9-31383c4ea5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.376179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074ce9-67af-4c95-80a9-31383c4ea5e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.390841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.496763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5074ce9-67af-4c95-80a9-31383c4ea5e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.501771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5074ce9-67af-4c95-80a9-31383c4ea5e7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.547038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031112-00cb-4b71-94c6-2b0cd76a3e94 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.563331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:08.577838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:08.621346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a41e5f-ba2b-443b-bccb-2a6303a17515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.622766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41e5f-ba2b-443b-bccb-2a6303a17515 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.623216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41e5f-ba2b-443b-bccb-2a6303a17515 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.623599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41e5f-ba2b-443b-bccb-2a6303a17515 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.624523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a41e5f-ba2b-443b-bccb-2a6303a17515 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.626170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a41e5f-ba2b-443b-bccb-2a6303a17515 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.658945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 429/867] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:08 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:08.721816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 439/868] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:08.723324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a41e5f-ba2b-443b-bccb-2a6303a17515 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.860613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a41e5f-ba2b-443b-bccb-2a6303a17515 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.910569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57003f3-b2e5-4b2f-8dd1-98f65dc5e89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.911472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57003f3-b2e5-4b2f-8dd1-98f65dc5e89c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.911912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57003f3-b2e5-4b2f-8dd1-98f65dc5e89c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.912310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57003f3-b2e5-4b2f-8dd1-98f65dc5e89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.930832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57003f3-b2e5-4b2f-8dd1-98f65dc5e89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.933371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57003f3-b2e5-4b2f-8dd1-98f65dc5e89c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a57003f3-b2e5-4b2f-8dd1-98f65dc5e89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:08.955829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:08.957931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:08.958883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:08.958883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:08.958883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:08.958883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 430/869] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:08.963182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074ce9-67af-4c95-80a9-31383c4ea5e7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:09.073129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074ce9-67af-4c95-80a9-31383c4ea5e7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:09.099624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:09.108063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760f9e-166d-4fcb-954a-a5e785cfd0fe None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.108373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760f9e-166d-4fcb-954a-a5e785cfd0fe None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.108720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760f9e-166d-4fcb-954a-a5e785cfd0fe None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.110477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 431/870] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:09.115240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:09.115868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.116121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bab6c-49f9-4721-8538-037c77694166 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.116313 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.116476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bab6c-49f9-4721-8538-037c77694166 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.116638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.116786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bab6c-49f9-4721-8538-037c77694166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.117115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:09.117449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:09.119191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:09.138158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b18bab6c-49f9-4721-8538-037c77694166 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:09.138855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 440/871] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:09.139411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b18bab6c-49f9-4721-8538-037c77694166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:09.143275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:09.157400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:09.246863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 432/872] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:09.330284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f85e2-8b4d-4872-8193-5f9fde91f239 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:09.388908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:09.389940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.390461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.390945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.399536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:09.401080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:09.415847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:09.418118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:09.420473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:09.420473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:09.420473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:09.420473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:09.420473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:09.420473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:09.420473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:09.420473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:09.426300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 441/873] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:09.427980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bab6c-49f9-4721-8538-037c77694166 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:09.541308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:09.587687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bab6c-49f9-4721-8538-037c77694166 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:09.643796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:09.644708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.645246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.645785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.646782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:09.647443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:09.649183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:09.666771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:09.668056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 433/874] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:09.674731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:09.695864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:09.704027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ba67-fac7-4b92-ac2c-c2e83b63d909 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:09.784954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2345c1b-5a75-4e9d-b611-b7bc7bbbb01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:09.787286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345c1b-5a75-4e9d-b611-b7bc7bbbb01c None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.787785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345c1b-5a75-4e9d-b611-b7bc7bbbb01c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.788280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345c1b-5a75-4e9d-b611-b7bc7bbbb01c None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.790341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2345c1b-5a75-4e9d-b611-b7bc7bbbb01c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:09.794568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2345c1b-5a75-4e9d-b611-b7bc7bbbb01c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:09.822166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2239a-6e59-4fa0-8143-068dda0b40a4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:09.828604 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 442/875] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:09 2022] POST /identity/v3/services => generated 269 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:09.878789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620ef4a-ec6a-45b7-abed-99362d7bbf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:09.879637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ef4a-ec6a-45b7-abed-99362d7bbf48 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.879924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ef4a-ec6a-45b7-abed-99362d7bbf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.880278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620ef4a-ec6a-45b7-abed-99362d7bbf48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.881024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620ef4a-ec6a-45b7-abed-99362d7bbf48 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=ef9aa824aafe4c499df84fa0c3fe3f42) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:09.881336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620ef4a-ec6a-45b7-abed-99362d7bbf48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:09.882934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620ef4a-ec6a-45b7-abed-99362d7bbf48 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:09.890841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 434/876] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:09 2022] GET /identity/v3/role_assignments?user.id=ef9aa824aafe4c499df84fa0c3fe3f42&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=b76f0bbd02794923b10af161becac1c6 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:10.469009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c16c8-b8b0-4530-b7d7-e3ef5a26c2c1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:10.469009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c16c8-b8b0-4530-b7d7-e3ef5a26c2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:10.469009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c16c8-b8b0-4530-b7d7-e3ef5a26c2c1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:10.471875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 443/877] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:10.479903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eaa54-d7cf-4ca4-819e-fd3f4d3d4b57 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:10.479903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eaa54-d7cf-4ca4-819e-fd3f4d3d4b57 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:10.481473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eaa54-d7cf-4ca4-819e-fd3f4d3d4b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:10.502039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-427eaa54-d7cf-4ca4-819e-fd3f4d3d4b57 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:10.503303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-427eaa54-d7cf-4ca4-819e-fd3f4d3d4b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:10.578792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:10.584946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 435/878] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:10.930150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77098-6f87-49eb-8ddc-18467aae3412 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:10.930613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77098-6f87-49eb-8ddc-18467aae3412 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:10.930902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77098-6f87-49eb-8ddc-18467aae3412 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:10.933211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 444/879] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:10.938942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6857-cb4e-4eb1-99ad-150a5002954f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:10.939222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6857-cb4e-4eb1-99ad-150a5002954f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:10.939487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd6857-cb4e-4eb1-99ad-150a5002954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:10.949886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b77098-6f87-49eb-8ddc-18467aae3412 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:10.981894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-90fd6857-cb4e-4eb1-99ad-150a5002954f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:10.984400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-90fd6857-cb4e-4eb1-99ad-150a5002954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:11.103610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 436/880] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:11.123380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b77098-6f87-49eb-8ddc-18467aae3412 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.126575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.162286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47435e8-f329-4c0e-be11-cb20941596bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.163103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47435e8-f329-4c0e-be11-cb20941596bf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.163481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47435e8-f329-4c0e-be11-cb20941596bf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.163854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47435e8-f329-4c0e-be11-cb20941596bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.176177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47435e8-f329-4c0e-be11-cb20941596bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e47435e8-f329-4c0e-be11-cb20941596bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:11.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:11.182339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:11.184259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 445/881] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:11.189357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd6857-cb4e-4eb1-99ad-150a5002954f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.321060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd6857-cb4e-4eb1-99ad-150a5002954f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.365236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.374400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.375364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.375750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.376222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.376947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:11.377254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.379613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.387951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47435e8-f329-4c0e-be11-cb20941596bf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.392486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 437/882] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:11.398202 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.542714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47435e8-f329-4c0e-be11-cb20941596bf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.549788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7dd89-9b91-4a32-8411-8cca30b7e997 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.591442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.592086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.592387 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.592648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.593250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.594661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.595410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.596226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.596676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.597111 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:11.605494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:11.606961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:11.607851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 446/883] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:11.615195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.620797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.622610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:11.638819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:11.639935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:11.640941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:11.640941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:11.640941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:11.647681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 438/884] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:11.648876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.662560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.716065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.772315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28006b-635e-4df5-a342-ced60a588540 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.800906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cbbc7-046f-45fa-8802-0fa464635679 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.846811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.848332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.849176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.849925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.851413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:11.852215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.855843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.871222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 447/885] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:11.875151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.876297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.876474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.876955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.877418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.878833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:11.879365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.881815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.914322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 439/886] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:11.916972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:12.068236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:12.090787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb4a54-46f7-4c60-b91a-eb8f500feb98 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.119704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5aec8-e594-4d23-81bb-203453482e15 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.125404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:12.161995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.163525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.164279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.165022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.166486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:12.168088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.170986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.187790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 448/887] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:12.192660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:12.199096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.201381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.201935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.202588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.218609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.221580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:12.250166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:12.252311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:12.260373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 440/888] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:12.271882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:12.360137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bdb1f-2060-4688-b10f-daa489e759e9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.402588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a317b6f-7819-4456-8a73-3ce925c76751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.403229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a317b6f-7819-4456-8a73-3ce925c76751 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.403512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a317b6f-7819-4456-8a73-3ce925c76751 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.403791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a317b6f-7819-4456-8a73-3ce925c76751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.404520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a317b6f-7819-4456-8a73-3ce925c76751 None admin] RBAC: Adding query filter params (interface=public, service_id=12dfc6fe4d91405faadf340129e92309, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:12.404835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a317b6f-7819-4456-8a73-3ce925c76751 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.406284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a317b6f-7819-4456-8a73-3ce925c76751 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.415207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 449/889] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 08:03:12 2022] GET /identity/v3/endpoints?service_id=12dfc6fe4d91405faadf340129e92309&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:12.421711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee2ee-5d6e-4378-a8ee-c516b8af796d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.421711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee2ee-5d6e-4378-a8ee-c516b8af796d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.421711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee2ee-5d6e-4378-a8ee-c516b8af796d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.421711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 450/890] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:12.423270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee2ee-5d6e-4378-a8ee-c516b8af796d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:12.456335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:12.456986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c95f8-206a-408d-ac61-59773335c369 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.507390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e0c9-d62d-4f22-afcb-cc93c0cb1db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.508022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e0c9-d62d-4f22-afcb-cc93c0cb1db1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.508438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e0c9-d62d-4f22-afcb-cc93c0cb1db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.508707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e0c9-d62d-4f22-afcb-cc93c0cb1db1 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.509496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e0c9-d62d-4f22-afcb-cc93c0cb1db1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:12.509806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e0c9-d62d-4f22-afcb-cc93c0cb1db1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.511605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e0c9-d62d-4f22-afcb-cc93c0cb1db1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.531824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 441/891] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 08:03:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:12.533091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4988-03e9-4123-89c0-1f934a719be1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.533375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4988-03e9-4123-89c0-1f934a719be1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.533625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4988-03e9-4123-89c0-1f934a719be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.553462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-09cc4988-03e9-4123-89c0-1f934a719be1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:12.555252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-09cc4988-03e9-4123-89c0-1f934a719be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:12.564126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee2ee-5d6e-4378-a8ee-c516b8af796d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.576837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:12.606799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccffb4f-9a89-4f19-b008-7327089315f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.607770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffb4f-9a89-4f19-b008-7327089315f4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.608356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffb4f-9a89-4f19-b008-7327089315f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.608820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffb4f-9a89-4f19-b008-7327089315f4 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.609896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccffb4f-9a89-4f19-b008-7327089315f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.612256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccffb4f-9a89-4f19-b008-7327089315f4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.638300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 451/892] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:12 2022] GET /identity/v3/services => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:03:12.638300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197424f3-bf51-4a3a-8b14-5d1c4d18ca59 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.638300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197424f3-bf51-4a3a-8b14-5d1c4d18ca59 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.638300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197424f3-bf51-4a3a-8b14-5d1c4d18ca59 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.638300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 452/893] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:12.638300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197424f3-bf51-4a3a-8b14-5d1c4d18ca59 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:12.655536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 442/894] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:12.657452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b6a0-e6b1-471b-9ea8-5a6d6bff063f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.657930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b6a0-e6b1-471b-9ea8-5a6d6bff063f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.658442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b6a0-e6b1-471b-9ea8-5a6d6bff063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.703178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-cf42b6a0-e6b1-471b-9ea8-5a6d6bff063f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:12.705028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cf42b6a0-e6b1-471b-9ea8-5a6d6bff063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:12.806476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 443/895] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:12.814770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:12.842222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197424f3-bf51-4a3a-8b14-5d1c4d18ca59 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.905686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab88ee-1731-4585-94e1-78533fc62700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.907150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab88ee-1731-4585-94e1-78533fc62700 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.907873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab88ee-1731-4585-94e1-78533fc62700 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.908598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab88ee-1731-4585-94e1-78533fc62700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.946752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42b6a0-e6b1-471b-9ea8-5a6d6bff063f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.029413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab88ee-1731-4585-94e1-78533fc62700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.031327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab88ee-1731-4585-94e1-78533fc62700 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.089593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:13.125012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42b6a0-e6b1-471b-9ea8-5a6d6bff063f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:13.141240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:13.166312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 453/896] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:12 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:13.167473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab88ee-1731-4585-94e1-78533fc62700 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.179130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:13.180197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:13.180713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:13.181342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:13.182025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.184160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:13.195703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:13.196942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:13.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 444/897] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:13.200346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.321910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab88ee-1731-4585-94e1-78533fc62700 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:13.324006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb8309-6f07-4d07-b4b6-faf849a3d812 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:13.367064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:13.367703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:13.368005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:13.368891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:13.369129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.371060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.374921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:13.375797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:13.376068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:13.376347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:13.380598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:13.382430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:13.384150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 454/898] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Sep 1 08:03:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:13.385692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.395069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.396523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.405949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:13.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:13.422466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:13.424445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:13.424445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:13.424445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:13.424445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 445/899] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:13.424445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.466842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:13.559646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e5e16-9f03-4496-b5a2-0881c93b15c9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:13.569286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7200-2cbe-4795-aedd-f0bcf612a601 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:13.602376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:13.603341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:13.603806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:13.604219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:13.605735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:13.606226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.608307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.612270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:13.612984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:13.613264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:13.613530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:13.614464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:13.614770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.615682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 455/900] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:13.616695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.621667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.627376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 446/901] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:13.627952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.700767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:13.757184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6761c2a-fb23-407b-81d9-fe38e17b1b73 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:13.757859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3569593-e2aa-414e-9d3a-89096e2c716a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:13.773309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:13.799511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:13.800131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:13.800417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:13.800711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:13.801355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:13.801664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.803077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.822361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 456/902] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:13.822563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:13.822700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.822789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:13.822789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:13.822789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:13.822789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:13.822789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.825849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.842308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 447/903] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:13.842308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:14.014185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c201e-4a3c-461a-8d0e-a6e7e6df4d16 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:14.021192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca880ec-8e4b-4da9-8334-4edfbf71c1ac None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:14.059224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:14.074467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:14.075265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.075552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.075821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.083873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:14.085349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:14.086653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:14.088281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.089607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.090327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.091657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:14.092372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:14.095195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:14.100035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:14.101875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:14.103996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 448/904] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:14.111122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:14.112574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 457/905] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:14.118830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:14.170614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:14.276279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ca1bd-15c6-4ce4-9cf9-20487d12dbe3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:14.310495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00ce5-3409-4e0c-b988-b9b644281b82 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:14.319940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:14.320830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.321298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.321721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.322633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:14.323090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:14.325618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:14.344871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 449/906] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:14.346191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:14.381096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:14.382401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.383016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.383644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.385094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] RBAC: Adding query filter params (interface=public, service_id=efe52dc7551749639a0b10fa1f573fdc, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:14.386287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:14.390000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:14.403432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:14.406531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 458/907] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 08:03:14 2022] GET /identity/v3/endpoints?service_id=efe52dc7551749639a0b10fa1f573fdc&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:14.409103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:14.472092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e04a9-2a15-492e-a4b7-6bbfbbf086e2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:14.513742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d0615-743a-4d1e-b5b3-b0daffb89368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:14.515219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d0615-743a-4d1e-b5b3-b0daffb89368 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.515937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d0615-743a-4d1e-b5b3-b0daffb89368 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.516367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d0615-743a-4d1e-b5b3-b0daffb89368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.517588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d0615-743a-4d1e-b5b3-b0daffb89368 None admin] RBAC: Adding query filter params (role.id=78930e293ae84688884690c965f65053, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=57b1ae1f4f4e4f199a3798a4ff0b83c5) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:14.518529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d0615-743a-4d1e-b5b3-b0daffb89368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:14.520743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d0615-743a-4d1e-b5b3-b0daffb89368 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:14.524692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:14.528195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bea49d-4670-4151-af8b-e85b392e911c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:14.539293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 450/908] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:14 2022] GET /identity/v3/role_assignments?user.id=57b1ae1f4f4e4f199a3798a4ff0b83c5&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=78930e293ae84688884690c965f65053 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:14.577341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f3d6-f448-4f5d-a81c-7ee35087dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:14.578008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f3d6-f448-4f5d-a81c-7ee35087dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.578357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f3d6-f448-4f5d-a81c-7ee35087dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.578752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f3d6-f448-4f5d-a81c-7ee35087dbd2 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.579380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701f3d6-f448-4f5d-a81c-7ee35087dbd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:14.580767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701f3d6-f448-4f5d-a81c-7ee35087dbd2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:14.588054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 459/909] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:14 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:03:14.782993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a301-4d09-491c-a7cc-9bbbaa21ab76 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.783568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a301-4d09-491c-a7cc-9bbbaa21ab76 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.783568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2a301-4d09-491c-a7cc-9bbbaa21ab76 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.785137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 451/910] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:14.791209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae9ded-710b-4ea7-9c9d-a2f8f0616e68 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.792211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae9ded-710b-4ea7-9c9d-a2f8f0616e68 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.792699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae9ded-710b-4ea7-9c9d-a2f8f0616e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.815218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d9ae9ded-710b-4ea7-9c9d-a2f8f0616e68 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:14.816811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d9ae9ded-710b-4ea7-9c9d-a2f8f0616e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:14.901582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 460/911] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:15.189405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2a301-4d09-491c-a7cc-9bbbaa21ab76 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:15.335517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2a301-4d09-491c-a7cc-9bbbaa21ab76 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:15.349576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:15.378655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:15.379314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.379600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.379866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.380483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:15.381886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:15.392640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:15.394726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:15.396391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 452/912] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:15.409347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae9ded-710b-4ea7-9c9d-a2f8f0616e68 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:15.580996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:15.588165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae9ded-710b-4ea7-9c9d-a2f8f0616e68 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:15.629354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:15.629981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.630284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.630575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.631232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:15.631542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:15.632931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:15.639569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 461/913] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:15.649038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:15.835530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecc8f4-d3f4-4afc-b9c6-3d56e3b16125 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:15.875771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1cb6c-59d8-4c35-a394-c8d516f5c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:15.876401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1cb6c-59d8-4c35-a394-c8d516f5c03a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.876678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1cb6c-59d8-4c35-a394-c8d516f5c03a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.876953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1cb6c-59d8-4c35-a394-c8d516f5c03a None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.877593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1cb6c-59d8-4c35-a394-c8d516f5c03a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:15.877946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1cb6c-59d8-4c35-a394-c8d516f5c03a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:15.879323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1cb6c-59d8-4c35-a394-c8d516f5c03a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:15.885391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 453/914] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 08:03:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:15.894862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:16.050391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab4ee-2a60-4363-bffe-1a6970b0e761 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:16.089794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075413-d1a6-48e3-9cb1-01870e43ddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:16.091000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075413-d1a6-48e3-9cb1-01870e43ddf9 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.091539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075413-d1a6-48e3-9cb1-01870e43ddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.092015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075413-d1a6-48e3-9cb1-01870e43ddf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.092956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70075413-d1a6-48e3-9cb1-01870e43ddf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:16.094598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70075413-d1a6-48e3-9cb1-01870e43ddf9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:16.136437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 462/915] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:16.554351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbded40-474b-44d8-ae90-9cf2961afc2e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.554794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbded40-474b-44d8-ae90-9cf2961afc2e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.554964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbded40-474b-44d8-ae90-9cf2961afc2e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.556553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 454/916] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:16.562181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874af9-af71-4be3-8477-d8b61d0896e7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.562598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874af9-af71-4be3-8477-d8b61d0896e7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.562809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874af9-af71-4be3-8477-d8b61d0896e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.583694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-57874af9-af71-4be3-8477-d8b61d0896e7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:16.584981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-57874af9-af71-4be3-8477-d8b61d0896e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:16.597544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:16.674022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 463/917] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:16.742318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999b72-f1ba-42b6-b396-ab73c42f50c3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.742583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999b72-f1ba-42b6-b396-ab73c42f50c3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.742986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999b72-f1ba-42b6-b396-ab73c42f50c3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.744881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 455/918] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:16.750870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60f58-93a0-4b95-ae49-a0cd238d66d7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.751246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60f58-93a0-4b95-ae49-a0cd238d66d7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.751426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60f58-93a0-4b95-ae49-a0cd238d66d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.770959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c7d60f58-93a0-4b95-ae49-a0cd238d66d7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:16.772169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c7d60f58-93a0-4b95-ae49-a0cd238d66d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:16.849641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 464/919] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:16.859774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e6af-4e1e-4011-8554-c9b1e319bf18 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.860318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e6af-4e1e-4011-8554-c9b1e319bf18 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.860318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e6af-4e1e-4011-8554-c9b1e319bf18 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.861926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 456/920] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:16.867667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9822046-ab13-4b70-90ee-d6378504741c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.867956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9822046-ab13-4b70-90ee-d6378504741c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.868597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9822046-ab13-4b70-90ee-d6378504741c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.891341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a9822046-ab13-4b70-90ee-d6378504741c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:16.892826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a9822046-ab13-4b70-90ee-d6378504741c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:16.950118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4e6af-4e1e-4011-8554-c9b1e319bf18 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:16.976826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:16.985139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 465/921] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:17.004448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:17.084286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4e6af-4e1e-4011-8554-c9b1e319bf18 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.126562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32920f9-2bc1-499d-931a-c198acdd66da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.127252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32920f9-2bc1-499d-931a-c198acdd66da None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.127533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32920f9-2bc1-499d-931a-c198acdd66da None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.127802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32920f9-2bc1-499d-931a-c198acdd66da None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.128462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32920f9-2bc1-499d-931a-c198acdd66da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:17.129842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32920f9-2bc1-499d-931a-c198acdd66da None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:17.148977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 457/922] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:16 2022] POST /identity/v3/services => generated 241 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:17.231094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9822046-ab13-4b70-90ee-d6378504741c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.275273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32920f9-2bc1-499d-931a-c198acdd66da None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.419215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9822046-ab13-4b70-90ee-d6378504741c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.450902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:17.476269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32920f9-2bc1-499d-931a-c198acdd66da None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.477167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a868f9-7eb3-419e-8d55-bc1e3d286867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.477887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a868f9-7eb3-419e-8d55-bc1e3d286867 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.478237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a868f9-7eb3-419e-8d55-bc1e3d286867 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.478611 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a868f9-7eb3-419e-8d55-bc1e3d286867 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.493095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a868f9-7eb3-419e-8d55-bc1e3d286867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-03a868f9-7eb3-419e-8d55-bc1e3d286867 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:17.500307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:17.502580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:17.504886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 466/923] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:17.515967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a868f9-7eb3-419e-8d55-bc1e3d286867 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.541714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.543263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.543833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.544237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.545217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:17.547005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:17.559314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:17.561131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:17.562912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 458/924] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:17.567023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.635868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:17.687777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a868f9-7eb3-419e-8d55-bc1e3d286867 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.725485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.726109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.726435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.726829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.727597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:17.727912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:17.729307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:17.739468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 467/925] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:17.749048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60fb7-dbfc-44f6-95ed-3e124c861468 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.751815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.791539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.792433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.792853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.793204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.793857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:17.794180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:17.795592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:17.806361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 459/926] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:17.811362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.847486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:17.938177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4310af-99bc-4546-9fee-0a1c44602fe8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.966397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:17.980281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8f5d-eafa-4d38-8169-cc5c2b570db4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.991451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.992134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.992393 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.992678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.009645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:18.011416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:18.032492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:18.033517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:18.034445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:18.034445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:18.034445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:18.035994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:18.041199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.041199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.041199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.041199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:18.041199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:18.041199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:18.042976 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 468/927] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:18.044210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:18.050358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 460/928] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:18.054015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:18.175619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464cadd-ed42-4e5b-99aa-ecbb0a224e5f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:18.181542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:18.202613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d00ac8-cd4d-4c14-8982-c6584dc24be0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:18.228094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:18.229366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.230680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.231788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.232473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:18.232787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:18.234188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:18.248528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ea1f-3c40-488c-8896-e669fa96e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:18.248870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ea1f-3c40-488c-8896-e669fa96e0e8 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.249072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ea1f-3c40-488c-8896-e669fa96e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.249354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ea1f-3c40-488c-8896-e669fa96e0e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.250035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852ea1f-3c40-488c-8896-e669fa96e0e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:18.251578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852ea1f-3c40-488c-8896-e669fa96e0e8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:18.253324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 469/929] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:18.258848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:18.286532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 461/930] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:18.305702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:18.398824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b460c2-1f82-4f37-91e8-1e3981c9e19f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:18.456475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5d758-fb59-44a5-8027-5dabc09836f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:18.457521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5d758-fb59-44a5-8027-5dabc09836f5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.458055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5d758-fb59-44a5-8027-5dabc09836f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.458607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5d758-fb59-44a5-8027-5dabc09836f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.468407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5d758-fb59-44a5-8027-5dabc09836f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:18.470310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5d758-fb59-44a5-8027-5dabc09836f5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-13f5d758-fb59-44a5-8027-5dabc09836f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:18.484524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:18.485555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:18.486617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 470/931] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:03:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:18.494808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ea1f-3c40-488c-8896-e669fa96e0e8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:18.513934 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be98e1c-369e-48fe-ae72-617c0396f301 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.514333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be98e1c-369e-48fe-ae72-617c0396f301 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.514544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be98e1c-369e-48fe-ae72-617c0396f301 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.516270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 471/932] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:18.522053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad202-4bd1-49c2-bc2b-47705a8dd538 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.522407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad202-4bd1-49c2-bc2b-47705a8dd538 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.522651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad202-4bd1-49c2-bc2b-47705a8dd538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.541837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d35ad202-4bd1-49c2-bc2b-47705a8dd538 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:18.543151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d35ad202-4bd1-49c2-bc2b-47705a8dd538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:18.635928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ea1f-3c40-488c-8896-e669fa96e0e8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:18.674286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 472/933] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:18.689552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:18.690587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.691086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.691587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.692796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:18.693355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:18.695712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:18.722729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:18.729278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 462/934] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 08:03:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:18.739658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ad202-4bd1-49c2-bc2b-47705a8dd538 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:18.774799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:18.884098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ad202-4bd1-49c2-bc2b-47705a8dd538 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:18.927086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:18.928080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.928588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.929093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.942129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:18.943994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:18.961116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:18.962145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:18.963090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:18.963090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:18.963090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:18.965724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 473/935] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:18.974952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.055071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.133143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:19.166978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc926983-f9c4-40a0-9309-7071ca9e2bcb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.181167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f92a-ddd4-40bb-9d49-796a3716b590 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.211298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.212303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.212801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.213330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.214977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:19.215520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.217246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.224715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.225482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.225844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.226282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.227856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.229587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.234049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING keystone.server.flask.common [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 08:03:19.240244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 463/936] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:19.241658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.258776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.sql.core [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 08:03:19.258776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 08:03:19.258776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [parameters: {'id': 'c7d27aeaa6f147b5aee6698c9bd86b78', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 08:03:19.258776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7d27aeaa6f147b5aee6698c9bd86b78.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7d27aeaa6f147b5aee6698c9bd86b78. Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:03:19.270212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 08:03:19.271150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application yield resource Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise self.value Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application session.commit() Sep 01 08:03:19.272124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.flush() Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application compat.raise_( Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 08:03:19.273064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 08:03:19.273999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:03:19.274862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [parameters: {'id': 'c7d27aeaa6f147b5aee6698c9bd86b78', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:19.275761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:19.277131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7d27aeaa6f147b5aee6698c9bd86b78. Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:19.281084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 474/937] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Sep 1 08:03:19 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:19.284881 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.341822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:19.399050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c783cf-15aa-469b-b579-f5b7c17e91f4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.429756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f098e-9ec2-4ba6-8b3d-3ba377c7975a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.455871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd515d29-563b-4453-a6fc-1d14538e3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.456836 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd515d29-563b-4453-a6fc-1d14538e3ecc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.457890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd515d29-563b-4453-a6fc-1d14538e3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.458410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd515d29-563b-4453-a6fc-1d14538e3ecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.462124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:19.471319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd515d29-563b-4453-a6fc-1d14538e3ecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.474797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd515d29-563b-4453-a6fc-1d14538e3ecc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.484678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.485330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.485707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.485960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-dd515d29-563b-4453-a6fc-1d14538e3ecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:19.488490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:19.490158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 464/938] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd65363-f57c-4bf2-a49b-104851b9f599 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.499477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd65363-f57c-4bf2-a49b-104851b9f599 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.500645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd65363-f57c-4bf2-a49b-104851b9f599 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.500780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.500780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.501004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 465/939] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:19.503577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92933e-f60d-4f2c-bb26-12d9bd1ec4e2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.504038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92933e-f60d-4f2c-bb26-12d9bd1ec4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.504436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92933e-f60d-4f2c-bb26-12d9bd1ec4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:19.522232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:19.523849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:19.525591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:19.525591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:19.525591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:19.525591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:19.525591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:19.525591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:19.525591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:19.525591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:19.528800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 475/940] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:19.531335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.534311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6b92933e-f60d-4f2c-bb26-12d9bd1ec4e2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:19.535667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6b92933e-f60d-4f2c-bb26-12d9bd1ec4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:19.624563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 466/941] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:19.625890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92933e-f60d-4f2c-bb26-12d9bd1ec4e2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.689184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a0066-9c1c-460a-a3f2-f1f19232955d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.698207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:19.733460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.734466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.734956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.735507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.736587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:19.737291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.739565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.758910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 476/942] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:19.770314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.771871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92933e-f60d-4f2c-bb26-12d9bd1ec4e2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.821942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.822731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.824143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.824428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.825732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:19.826087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.828233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.858290 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:19.866406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 467/943] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:19.946823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cbee0-9199-4cd1-84b2-99f3c53a3976 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.982928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.991797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636713e-6dcc-4f42-be1c-6774472eb298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.993636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636713e-6dcc-4f42-be1c-6774472eb298 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.994096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636713e-6dcc-4f42-be1c-6774472eb298 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.994548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636713e-6dcc-4f42-be1c-6774472eb298 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/57b1ae1f4f4e4f199a3798a4ff0b83c5/roles/78930e293ae84688884690c965f65053` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.999301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636713e-6dcc-4f42-be1c-6774472eb298 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=57b1ae1f4f4e4f199a3798a4ff0b83c5, role_id=78930e293ae84688884690c965f65053)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:20.001307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636713e-6dcc-4f42-be1c-6774472eb298 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:20.023706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 477/944] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:19 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/57b1ae1f4f4e4f199a3798a4ff0b83c5/roles/78930e293ae84688884690c965f65053 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:03:20.128851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2457-2153-4988-b736-924a8e518774 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:20.145231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:20.178341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:20.179188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.179425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.179710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.180332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:20.182192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:20.194532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:20.195610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:20.196477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:20.197926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 468/945] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:20.204026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636713e-6dcc-4f42-be1c-6774472eb298 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:20.340727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636713e-6dcc-4f42-be1c-6774472eb298 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:20.343548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:20.383690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d0e1c-6760-4ccb-aedd-57a841dcdb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:20.384366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0e1c-6760-4ccb-aedd-57a841dcdb2b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.384650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0e1c-6760-4ccb-aedd-57a841dcdb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.384924 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d0e1c-6760-4ccb-aedd-57a841dcdb2b None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.385568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d0e1c-6760-4ccb-aedd-57a841dcdb2b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:20.385977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d0e1c-6760-4ccb-aedd-57a841dcdb2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:20.387726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d0e1c-6760-4ccb-aedd-57a841dcdb2b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:20.394084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 478/946] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:20.399538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:20.436288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1325-38be-4b27-8335-ef876e398ae0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.436620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1325-38be-4b27-8335-ef876e398ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.436847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1325-38be-4b27-8335-ef876e398ae0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.445154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 479/947] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:20.451735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165f2c-bce7-41ac-b3fe-8559b6a24e4a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.452152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165f2c-bce7-41ac-b3fe-8559b6a24e4a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.452531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165f2c-bce7-41ac-b3fe-8559b6a24e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.483476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a9165f2c-bce7-41ac-b3fe-8559b6a24e4a None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:20.485317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a9165f2c-bce7-41ac-b3fe-8559b6a24e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:20.563699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655f38-b6d1-4099-8993-ce635b1ee1e1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:20.605550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 480/948] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:20.627107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:20.628402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.628994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.629527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.630714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:20.631284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:20.633369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:20.641735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 469/949] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:20.653859 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9165f2c-bce7-41ac-b3fe-8559b6a24e4a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:20.755343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:20.759468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9165f2c-bce7-41ac-b3fe-8559b6a24e4a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:20.797879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:20.798533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.798817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.799092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.799821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] RBAC: Adding query filter params (interface=public, service_id=cfe7626440004321927e02ca82f08476, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:20.800129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:20.801560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:20.808118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 481/950] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 08:03:20 2022] GET /identity/v3/endpoints?service_id=cfe7626440004321927e02ca82f08476&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:20.817979 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:20.902809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:20.997995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:21.024537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1250a-2976-453b-8ab6-169c912f2171 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:21.087823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d5b4-0e4f-4138-acbc-853acd8c5f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:21.088614 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d5b4-0e4f-4138-acbc-853acd8c5f51 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.089473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d5b4-0e4f-4138-acbc-853acd8c5f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.090442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d5b4-0e4f-4138-acbc-853acd8c5f51 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.091086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5d5b4-0e4f-4138-acbc-853acd8c5f51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:21.092584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5d5b4-0e4f-4138-acbc-853acd8c5f51 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:21.099531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 470/951] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:20 2022] GET /identity/v3/services => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:03:21.150944 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53836-998c-44e4-b682-0c24de467667 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:21.211389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:21.212288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.212288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.212593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.213194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:21.218674 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:21.227605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:21.230613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:21.232765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 482/952] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:21.240981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d5b4-0e4f-4138-acbc-853acd8c5f51 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:21.429504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d5b4-0e4f-4138-acbc-853acd8c5f51 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:21.432059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:21.477990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1296b57-d46a-4f30-8e07-aacd8b25c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:21.479279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296b57-d46a-4f30-8e07-aacd8b25c173 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.480406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296b57-d46a-4f30-8e07-aacd8b25c173 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.480940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296b57-d46a-4f30-8e07-aacd8b25c173 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.482017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296b57-d46a-4f30-8e07-aacd8b25c173 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:21.482699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296b57-d46a-4f30-8e07-aacd8b25c173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:21.484895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296b57-d46a-4f30-8e07-aacd8b25c173 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:21.491973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 471/953] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:21.499180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:21.544009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:21.678446 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ad652-64bc-4182-8a5b-ec232c1d3aa6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:21.740210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c4fd5-e94e-420a-afc7-3323effa9f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:21.741626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4fd5-e94e-420a-afc7-3323effa9f2b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.742402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4fd5-e94e-420a-afc7-3323effa9f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.743115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c4fd5-e94e-420a-afc7-3323effa9f2b None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.744841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c4fd5-e94e-420a-afc7-3323effa9f2b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:21.746203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c4fd5-e94e-420a-afc7-3323effa9f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:21.749160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c4fd5-e94e-420a-afc7-3323effa9f2b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:21.758006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 483/954] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:22.055689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987d0a-8fb9-4abd-8566-8e7c5d362b0c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.056192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987d0a-8fb9-4abd-8566-8e7c5d362b0c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.056673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987d0a-8fb9-4abd-8566-8e7c5d362b0c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.059490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 472/955] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:22.065443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825d8f-3b29-4ca0-9629-124288f80857 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.066034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825d8f-3b29-4ca0-9629-124288f80857 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.066563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825d8f-3b29-4ca0-9629-124288f80857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.092128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4c825d8f-3b29-4ca0-9629-124288f80857 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:22.094710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4c825d8f-3b29-4ca0-9629-124288f80857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:22.222424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 484/956] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:22.332171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4bd8-908b-49f9-a62a-066418dbc929 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.332673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4bd8-908b-49f9-a62a-066418dbc929 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.332673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4bd8-908b-49f9-a62a-066418dbc929 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.334289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 473/957] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:22.340681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ebbf8-a865-4fe9-9411-9a8b8e3ac738 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.341281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ebbf8-a865-4fe9-9411-9a8b8e3ac738 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.341762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ebbf8-a865-4fe9-9411-9a8b8e3ac738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.362153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-144ebbf8-a865-4fe9-9411-9a8b8e3ac738 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:22.363757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-144ebbf8-a865-4fe9-9411-9a8b8e3ac738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:22.381493 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:22.467575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 485/958] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:22.599531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4bd8-908b-49f9-a62a-066418dbc929 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.746092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4bd8-908b-49f9-a62a-066418dbc929 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.798178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ebbf8-a865-4fe9-9411-9a8b8e3ac738 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.806417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:22.807044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.807325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.807657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.808824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:22.810300 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:22.813122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING keystone.server.flask.common [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 08:03:22.832315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.sql.core [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 08:03:22.832315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 08:03:22.832315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [parameters: {'user_id': '7676104d66d449409026a81354dd3fc0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 08:03:22.832315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81701) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application result.read() Sep 01 08:03:22.854370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:03:22.857253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application yield resource Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise self.value Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application session.commit() Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 08:03:22.861885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.session.flush() Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application compat.raise_( Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 08:03:22.871875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:03:22.874527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application result.read() Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:03:22.877069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [parameters: {'user_id': '7676104d66d449409026a81354dd3fc0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:22.879116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 08:03:22.880733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 08:03:22.894948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 08:03:22.894948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 08:03:22.894948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 08:03:22.894948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 08:03:22.894948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 08:03:22.894948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:22.894948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 474/959] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 08:03:22 2022] POST /identity/v3/users => generated 160 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:22.894948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.919659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:22.968577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ebbf8-a865-4fe9-9411-9a8b8e3ac738 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.012047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6dd34-11b2-44e0-9c83-68470233a2ee None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.022172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa755f1b-8162-4f31-b50f-01929a035c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.022892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa755f1b-8162-4f31-b50f-01929a035c53 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.023181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa755f1b-8162-4f31-b50f-01929a035c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.023463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa755f1b-8162-4f31-b50f-01929a035c53 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.043265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa755f1b-8162-4f31-b50f-01929a035c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:23.054031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.054853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.055238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.055599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fa755f1b-8162-4f31-b50f-01929a035c53 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:23.056118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:23.058152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:23.059625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 486/960] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:23.068097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa755f1b-8162-4f31-b50f-01929a035c53 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.072337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.074975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.101761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:23.109147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:23.111241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:03:23.113373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:23.125627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 475/961] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:23.127388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.220530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa755f1b-8162-4f31-b50f-01929a035c53 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.251854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.261587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa6530-22ce-4537-a6b1-9b6375d15a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.262567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa6530-22ce-4537-a6b1-9b6375d15a9a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.263027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa6530-22ce-4537-a6b1-9b6375d15a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.263485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa6530-22ce-4537-a6b1-9b6375d15a9a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.264456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa6530-22ce-4537-a6b1-9b6375d15a9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:23.264958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa6530-22ce-4537-a6b1-9b6375d15a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.267278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa6530-22ce-4537-a6b1-9b6375d15a9a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.272955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7549874-c663-46b5-9957-66e90a106267 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.286622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 487/962] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:23.288798 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38461c5-d56a-4501-a708-09003b458373 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.289679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38461c5-d56a-4501-a708-09003b458373 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.289965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38461c5-d56a-4501-a708-09003b458373 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.292589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 488/963] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:23.293194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38461c5-d56a-4501-a708-09003b458373 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.325353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253fd51-f999-400a-a0bd-56652c3d4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.326176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fd51-f999-400a-a0bd-56652c3d4762 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.326384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fd51-f999-400a-a0bd-56652c3d4762 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.326560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fd51-f999-400a-a0bd-56652c3d4762 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.328703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fd51-f999-400a-a0bd-56652c3d4762 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:23.328703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fd51-f999-400a-a0bd-56652c3d4762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.329622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fd51-f999-400a-a0bd-56652c3d4762 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.370346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 476/964] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:23.371641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f79ed-3cd1-4445-88e2-d71fe9088fb7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.371931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f79ed-3cd1-4445-88e2-d71fe9088fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.372207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f79ed-3cd1-4445-88e2-d71fe9088fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.395686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bb6f79ed-3cd1-4445-88e2-d71fe9088fb7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:23.397332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bb6f79ed-3cd1-4445-88e2-d71fe9088fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:23.402842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.460901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38461c5-d56a-4501-a708-09003b458373 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.518536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 477/965] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:23.528699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.529577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.529888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.530217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.544247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.545713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:23.564680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:23.565708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:23.566650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:23.566650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:23.566650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:23.566838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 489/966] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:23.577400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f79ed-3cd1-4445-88e2-d71fe9088fb7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.670668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.696395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f79ed-3cd1-4445-88e2-d71fe9088fb7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.735083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.735699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.735987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.736258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.736919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:23.737223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.738634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.753793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 478/967] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:23.763945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.858603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.931496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5891237-3291-4d89-8c85-7bf71c4df5eb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.969919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.990190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.990907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.991361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.991862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.007298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.010083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.018244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10234-5fbe-441c-a22a-37223323e5f7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:24.033530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:24.035594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:24.037357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 490/968] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:24.042926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.080243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07320961-9314-42b7-9d39-520426f8500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.081315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320961-9314-42b7-9d39-520426f8500e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.081812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320961-9314-42b7-9d39-520426f8500e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.082340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320961-9314-42b7-9d39-520426f8500e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.083419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07320961-9314-42b7-9d39-520426f8500e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.086028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07320961-9314-42b7-9d39-520426f8500e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.091498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-07320961-9314-42b7-9d39-520426f8500e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:24.104110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:24.105655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:24.106653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:24.113162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 479/969] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:24.115331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3646-fb8e-4260-aebc-030203e62f39 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.115638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3646-fb8e-4260-aebc-030203e62f39 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.116100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3646-fb8e-4260-aebc-030203e62f39 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.118955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 480/970] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:24.120215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc3646-fb8e-4260-aebc-030203e62f39 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.157997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86d3b8-6fd6-4e11-a8b3-a98866c5d6fe None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.192745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbd0bc-853e-4b60-b16f-ec3993ffbf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.193274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbd0bc-853e-4b60-b16f-ec3993ffbf08 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.193552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbd0bc-853e-4b60-b16f-ec3993ffbf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.193822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbd0bc-853e-4b60-b16f-ec3993ffbf08 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.194595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbd0bc-853e-4b60-b16f-ec3993ffbf08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:24.194898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbd0bc-853e-4b60-b16f-ec3993ffbf08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.196337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbd0bc-853e-4b60-b16f-ec3993ffbf08 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.215791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 491/971] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 08:03:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:24.217453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31063e-155e-44c5-9f05-d8e857c29aa1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.217743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31063e-155e-44c5-9f05-d8e857c29aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.218023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31063e-155e-44c5-9f05-d8e857c29aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.237587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9a31063e-155e-44c5-9f05-d8e857c29aa1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:24.238843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a31063e-155e-44c5-9f05-d8e857c29aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:24.277622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc3646-fb8e-4260-aebc-030203e62f39 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.279067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.316150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.316775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.317048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.317313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.317955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:24.318284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.319659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.321055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 492/972] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:24.322099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31063e-155e-44c5-9f05-d8e857c29aa1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.327644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 481/973] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:24.337011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.425282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.452163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31063e-155e-44c5-9f05-d8e857c29aa1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.493226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122091-902b-415e-8312-8b35c768baeb None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.508609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41835c29-93dd-4196-a8f5-78f60a24154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.509529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41835c29-93dd-4196-a8f5-78f60a24154a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.510008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41835c29-93dd-4196-a8f5-78f60a24154a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.511046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41835c29-93dd-4196-a8f5-78f60a24154a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.537573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.538189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.538497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.538775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.539412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:24.539716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.541090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.551689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 482/974] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:24.552762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.583324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.621698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41835c29-93dd-4196-a8f5-78f60a24154a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.623309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41835c29-93dd-4196-a8f5-78f60a24154a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.687854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce25f46-1677-4258-ab5f-cf2dfca3030c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.715475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.724086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d15ce-a632-43ed-aa29-b85bb354e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.724697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d15ce-a632-43ed-aa29-b85bb354e15c None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.724972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d15ce-a632-43ed-aa29-b85bb354e15c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.725246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d15ce-a632-43ed-aa29-b85bb354e15c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.725927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d15ce-a632-43ed-aa29-b85bb354e15c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.727328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d15ce-a632-43ed-aa29-b85bb354e15c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.746880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 493/975] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:24 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:24.746880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41835c29-93dd-4196-a8f5-78f60a24154a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.752808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 483/976] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:24.753946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d15ce-a632-43ed-aa29-b85bb354e15c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.886942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.940774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d15ce-a632-43ed-aa29-b85bb354e15c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.943710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41835c29-93dd-4196-a8f5-78f60a24154a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.987740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c315-ef4f-43a2-b489-44f823c627ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.988274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c315-ef4f-43a2-b489-44f823c627ce None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.988555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c315-ef4f-43a2-b489-44f823c627ce None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.989148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c315-ef4f-43a2-b489-44f823c627ce None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.989483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5c315-ef4f-43a2-b489-44f823c627ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.990895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5c315-ef4f-43a2-b489-44f823c627ce None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:25.001822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:25.002512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.002790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.003071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:25.010343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 494/977] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:24 2022] POST /identity/v3/services => generated 242 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:25.017672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:25.019203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:25.036348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:25.037543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:25.038604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:25.038604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:25.038604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:25.042829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 484/978] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:25.043932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c315-ef4f-43a2-b489-44f823c627ce None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:25.176671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c315-ef4f-43a2-b489-44f823c627ce None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:25.206704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:25.217696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:25.218365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.218647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.218919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:25.219579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:25.219882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:25.221266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:25.234399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 495/979] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:25.240042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:25.287996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:25.409393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ffdf6-6f97-4179-9c0e-408c0307398a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:25.460440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:25.461410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.461410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.461684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:25.471541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:25.473072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:25.488187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:25.489958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:25.492387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 485/980] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:25.497192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:25.612123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184b42e-3acc-4ed7-bf97-b93b0e32db7a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:25.651766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959c615-e19b-42bf-86ee-d29f1e858bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:25.652570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959c615-e19b-42bf-86ee-d29f1e858bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.652981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959c615-e19b-42bf-86ee-d29f1e858bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.653388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959c615-e19b-42bf-86ee-d29f1e858bb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:25.654207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959c615-e19b-42bf-86ee-d29f1e858bb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:25.654675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959c615-e19b-42bf-86ee-d29f1e858bb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:25.656242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959c615-e19b-42bf-86ee-d29f1e858bb4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:25.675504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 496/981] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:25.677072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:25.786232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:25.798762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50455d7-7c89-4216-9975-163d49b82e5a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:25.844459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ea709-661a-4caf-acec-adab21dfa6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:25.845143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea709-661a-4caf-acec-adab21dfa6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.845563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea709-661a-4caf-acec-adab21dfa6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.845866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea709-661a-4caf-acec-adab21dfa6d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:25.846941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ea709-661a-4caf-acec-adab21dfa6d5 None admin] RBAC: Adding query filter params (role.id=78930e293ae84688884690c965f65053, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=57b1ae1f4f4e4f199a3798a4ff0b83c5) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:25.847268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ea709-661a-4caf-acec-adab21dfa6d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:25.848884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ea709-661a-4caf-acec-adab21dfa6d5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:25.857940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 486/982] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:25 2022] GET /identity/v3/role_assignments?user.id=57b1ae1f4f4e4f199a3798a4ff0b83c5&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=78930e293ae84688884690c965f65053 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:26.886813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74015cd1-1dfd-4993-9caf-943291d4dd6a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:26.887383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74015cd1-1dfd-4993-9caf-943291d4dd6a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:26.887605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74015cd1-1dfd-4993-9caf-943291d4dd6a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:26.889457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 497/983] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:26.895284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8191a3f-36a7-4489-9d26-7209c94bc8ee None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:26.896018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8191a3f-36a7-4489-9d26-7209c94bc8ee None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:26.896018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8191a3f-36a7-4489-9d26-7209c94bc8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:26.915282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b8191a3f-36a7-4489-9d26-7209c94bc8ee None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:26.916513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b8191a3f-36a7-4489-9d26-7209c94bc8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:27.022299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 487/984] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:27.101808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc297290-797a-4c58-be80-b10ddd461ef1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.102137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc297290-797a-4c58-be80-b10ddd461ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.102402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc297290-797a-4c58-be80-b10ddd461ef1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.103907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 498/985] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:27.109717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1024501-7436-4474-bb3d-1512259bad9f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.110003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1024501-7436-4474-bb3d-1512259bad9f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.110310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1024501-7436-4474-bb3d-1512259bad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.139582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b1024501-7436-4474-bb3d-1512259bad9f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:27.141567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b1024501-7436-4474-bb3d-1512259bad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:27.238691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 488/986] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:27.302004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc297290-797a-4c58-be80-b10ddd461ef1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.375839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.468812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc297290-797a-4c58-be80-b10ddd461ef1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.515770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1024501-7436-4474-bb3d-1512259bad9f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.536668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.538697 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.540001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.540225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.542150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.542150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.545965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:27.558438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:27.559686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:27.561794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 499/987] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:27.566820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.670452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1024501-7436-4474-bb3d-1512259bad9f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.695853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63a94a-347a-45b2-917b-7416e58c0452 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.711251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.727499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.728032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.728310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.728583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.729176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.731275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:27.741171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:27.743163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:27.746044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 489/988] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:27.749434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.763424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.764730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.765491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.766131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.767616 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:27.768403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.771180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.781301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 500/989] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:27.787890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.869572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.900144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388833c9-2f7c-470a-8a08-2224220498ea None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.936355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a162d1e-1456-458d-83ec-d5c8206690e6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.947069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af263b80-3f9e-44ce-84b2-695897055219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.947918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af263b80-3f9e-44ce-84b2-695897055219 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.948308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af263b80-3f9e-44ce-84b2-695897055219 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.948694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af263b80-3f9e-44ce-84b2-695897055219 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.949569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af263b80-3f9e-44ce-84b2-695897055219 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:27.949894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af263b80-3f9e-44ce-84b2-695897055219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.952166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af263b80-3f9e-44ce-84b2-695897055219 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.958367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 490/990] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:27.959798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cca45-5175-4503-a397-a6f1fb192395 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.960090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cca45-5175-4503-a397-a6f1fb192395 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.960365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cca45-5175-4503-a397-a6f1fb192395 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.961673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 491/991] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:27.964708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cca45-5175-4503-a397-a6f1fb192395 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.978009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5180f-08ec-4ed2-a288-c1bc95d1046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.978577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5180f-08ec-4ed2-a288-c1bc95d1046c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.978860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5180f-08ec-4ed2-a288-c1bc95d1046c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.979139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5180f-08ec-4ed2-a288-c1bc95d1046c None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.980385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5180f-08ec-4ed2-a288-c1bc95d1046c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:27.980739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5180f-08ec-4ed2-a288-c1bc95d1046c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.982191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5180f-08ec-4ed2-a288-c1bc95d1046c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.987999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 501/992] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:27.989217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a32bb-90dc-49c5-ab50-9c4a796a5847 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.989505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a32bb-90dc-49c5-ab50-9c4a796a5847 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.989862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a32bb-90dc-49c5-ab50-9c4a796a5847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.010182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-541a32bb-90dc-49c5-ab50-9c4a796a5847 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:28.011832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-541a32bb-90dc-49c5-ab50-9c4a796a5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:28.050475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.093750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 502/993] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:28.094675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a32bb-90dc-49c5-ab50-9c4a796a5847 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.102059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cca45-5175-4503-a397-a6f1fb192395 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.145672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.146309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.146599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.146888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.147534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:28.147838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.149229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.155646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 492/994] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:28.161682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.175481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.229512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a32bb-90dc-49c5-ab50-9c4a796a5847 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.275319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.275953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.276782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.277098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.278109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] RBAC: Adding query filter params (interface=admin, service_id=cfe7626440004321927e02ca82f08476, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:28.278452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.279875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.287614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 503/995] 10.222.0.43 () {56 vars in 1249 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/endpoints?service_id=cfe7626440004321927e02ca82f08476&interface=admin®ion_id=RegionOne => generated 193 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:28.296105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.333177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267cbb5-74d4-4499-989e-cde565e93fd2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.343071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.389121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.390081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.390564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.391000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.392172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] RBAC: Adding query filter params (interface=public, service_id=4aed43c4fa5f455c9504ffc21ab6b542, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:28.392660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.395395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.404669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 493/996] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/endpoints?service_id=4aed43c4fa5f455c9504ffc21ab6b542&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:28.405980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.430787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846dc23-b4bd-40a3-8565-936ebdfb7f45 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.475238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260124a-afb0-43c1-a3cc-2c0b1565a917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.475888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260124a-afb0-43c1-a3cc-2c0b1565a917 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.476179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260124a-afb0-43c1-a3cc-2c0b1565a917 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.476460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260124a-afb0-43c1-a3cc-2c0b1565a917 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.477100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260124a-afb0-43c1-a3cc-2c0b1565a917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.478595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260124a-afb0-43c1-a3cc-2c0b1565a917 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.486573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 504/997] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/services => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:03:28.487340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260124a-afb0-43c1-a3cc-2c0b1565a917 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.516309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.554944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0c49-049f-42e9-9add-883d62382ba7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.619834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.620732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.621405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.621878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.622798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.625317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:28.642232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:28.643363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:28.644234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 494/998] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/services/image => generated 86 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:28.650464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.672667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.676752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260124a-afb0-43c1-a3cc-2c0b1565a917 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.721437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec44d9-c5c4-4a8b-87ee-6d00066f7447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.722482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec44d9-c5c4-4a8b-87ee-6d00066f7447 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.722979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec44d9-c5c4-4a8b-87ee-6d00066f7447 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.723495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec44d9-c5c4-4a8b-87ee-6d00066f7447 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.724238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec44d9-c5c4-4a8b-87ee-6d00066f7447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.725722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec44d9-c5c4-4a8b-87ee-6d00066f7447 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.734307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 505/999] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/services => generated 1727 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:03:28.781043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29a9b-c244-4e71-897e-51765c6d92c5 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.829227 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d60f4c-cff4-4772-8d41-709afa3a364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.829868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d60f4c-cff4-4772-8d41-709afa3a364f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.830286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d60f4c-cff4-4772-8d41-709afa3a364f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.830576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d60f4c-cff4-4772-8d41-709afa3a364f None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.831747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d60f4c-cff4-4772-8d41-709afa3a364f None admin] RBAC: Adding query filter params (name=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:28.832298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d60f4c-cff4-4772-8d41-709afa3a364f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.834814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d60f4c-cff4-4772-8d41-709afa3a364f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.838192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.846022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 495/1000] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:28.851602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec44d9-c5c4-4a8b-87ee-6d00066f7447 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.976917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec44d9-c5c4-4a8b-87ee-6d00066f7447 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:29.015799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3103a-34d9-41ac-a598-9a5e20f2b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:29.016422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3103a-34d9-41ac-a598-9a5e20f2b920 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:29.016700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3103a-34d9-41ac-a598-9a5e20f2b920 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:29.016972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3103a-34d9-41ac-a598-9a5e20f2b920 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:29.017678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3103a-34d9-41ac-a598-9a5e20f2b920 None admin] RBAC: Adding query filter params (type=image) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:29.017977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3103a-34d9-41ac-a598-9a5e20f2b920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:29.019456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3103a-34d9-41ac-a598-9a5e20f2b920 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:29.024817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 506/1001] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:30.550343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfd6b-52f0-4ea8-acbf-59786d74be66 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:30.550907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfd6b-52f0-4ea8-acbf-59786d74be66 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:30.550907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfd6b-52f0-4ea8-acbf-59786d74be66 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:30.552414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 496/1002] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:30.558159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b86fe-81ed-4457-8602-46cb16cae6af None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:30.558729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b86fe-81ed-4457-8602-46cb16cae6af None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:30.559088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b86fe-81ed-4457-8602-46cb16cae6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:30.580361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-004b86fe-81ed-4457-8602-46cb16cae6af None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:30.581598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-004b86fe-81ed-4457-8602-46cb16cae6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:30.610159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:30.667544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 507/1003] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:30.741477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f520387-a61e-4ef5-b2e4-162567830481 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:30.741653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f520387-a61e-4ef5-b2e4-162567830481 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:30.741932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f520387-a61e-4ef5-b2e4-162567830481 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:30.743707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 497/1004] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:30.749532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d96cf-311c-475f-b916-787dca9f47e5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:30.749820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d96cf-311c-475f-b916-787dca9f47e5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:30.750102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d96cf-311c-475f-b916-787dca9f47e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:30.768931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fc9d96cf-311c-475f-b916-787dca9f47e5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:30.770144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fc9d96cf-311c-475f-b916-787dca9f47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:30.871922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 508/1005] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:30.939965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f520387-a61e-4ef5-b2e4-162567830481 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.016501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919ca7-91dd-4cd5-9020-e74c137062eb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.016787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919ca7-91dd-4cd5-9020-e74c137062eb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.016963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919ca7-91dd-4cd5-9020-e74c137062eb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.018462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 509/1006] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:31.023561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96e93c-132b-4829-bdf2-242286d13c6f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.023841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96e93c-132b-4829-bdf2-242286d13c6f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.024111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96e93c-132b-4829-bdf2-242286d13c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.042777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4d96e93c-132b-4829-bdf2-242286d13c6f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:31.043973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4d96e93c-132b-4829-bdf2-242286d13c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:31.057240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f520387-a61e-4ef5-b2e4-162567830481 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.098429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.099078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.099361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.100109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.100254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.101586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:31.111630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:31.112687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:31.113831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 498/1007] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:31.118958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.134461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 510/1008] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:31.187159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:31.228591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ce89-5d11-45d4-b6c3-5ef98f4e7491 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.235545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96e93c-132b-4829-bdf2-242286d13c6f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.257742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:31.273613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.274151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.274467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.274765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.275400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:31.275701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.277154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.282555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 499/1009] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:31.288335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.364571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96e93c-132b-4829-bdf2-242286d13c6f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.399373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284f19-bd20-4c07-8fa3-4349ba3f150d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.405099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.405748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.406037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.406348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.406946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.408869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:31.418575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:31.421231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:31.424658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 511/1010] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:31.425813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.437367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:31.446120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.446755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.447042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.447314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.447950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:31.448343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.449781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.454827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 500/1011] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:31.455630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.507866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:31.528983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18359c4-a300-4f28-a448-dc91c5e627d2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.559426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922a41c-74f2-4b10-b7d9-bc8cfc121b5f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.562936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098496f6-7463-4621-befa-f594c1a159bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.563545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098496f6-7463-4621-befa-f594c1a159bb None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.563826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098496f6-7463-4621-befa-f594c1a159bb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.564099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098496f6-7463-4621-befa-f594c1a159bb None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.564788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098496f6-7463-4621-befa-f594c1a159bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.566188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098496f6-7463-4621-befa-f594c1a159bb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.582726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 512/1012] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:31 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:31.583543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098496f6-7463-4621-befa-f594c1a159bb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.609250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.609884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.610164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.610473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.611125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:31.611431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.613234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.622705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 501/1013] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:31.627068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.687887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:31.717301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098496f6-7463-4621-befa-f594c1a159bb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.744816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb530dd0-a88d-453d-b36c-0d2115f94d13 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.762642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4145d-4e12-456d-a68d-3b92d302d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.763277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4145d-4e12-456d-a68d-3b92d302d748 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.763563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4145d-4e12-456d-a68d-3b92d302d748 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.763840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4145d-4e12-456d-a68d-3b92d302d748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.764528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4145d-4e12-456d-a68d-3b92d302d748 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.766379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4145d-4e12-456d-a68d-3b92d302d748 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.778096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:31.790822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 513/1014] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:31.792385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4516ec-d8cc-40a9-932a-2670b67356c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.793369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4516ec-d8cc-40a9-932a-2670b67356c9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.793753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4516ec-d8cc-40a9-932a-2670b67356c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.794087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4516ec-d8cc-40a9-932a-2670b67356c9 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.794869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4516ec-d8cc-40a9-932a-2670b67356c9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:31.795247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4516ec-d8cc-40a9-932a-2670b67356c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.796749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4516ec-d8cc-40a9-932a-2670b67356c9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.802967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 502/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:31.809965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4145d-4e12-456d-a68d-3b92d302d748 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.927946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4145d-4e12-456d-a68d-3b92d302d748 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.965939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89234-641a-41b6-a3b4-dbcee3be25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.966609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89234-641a-41b6-a3b4-dbcee3be25c8 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.966896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89234-641a-41b6-a3b4-dbcee3be25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.967175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89234-641a-41b6-a3b4-dbcee3be25c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.967855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89234-641a-41b6-a3b4-dbcee3be25c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.969228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89234-641a-41b6-a3b4-dbcee3be25c8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.989012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 514/1016] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:33.550117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690581e-522e-474d-aa7a-1689351faee7 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:33.550718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690581e-522e-474d-aa7a-1689351faee7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:33.550718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690581e-522e-474d-aa7a-1689351faee7 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:33.552081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 503/1017] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:33.557105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45689ca7-dc1d-447f-86da-be249bfcbe02 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:33.558003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45689ca7-dc1d-447f-86da-be249bfcbe02 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:33.558290 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45689ca7-dc1d-447f-86da-be249bfcbe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:33.577301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-45689ca7-dc1d-447f-86da-be249bfcbe02 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:33.578531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-45689ca7-dc1d-447f-86da-be249bfcbe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:33.632186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:33.657783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 515/1018] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:33.727786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90a11-2641-484b-8f4a-2149fea63403 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:33.727980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90a11-2641-484b-8f4a-2149fea63403 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:33.728238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90a11-2641-484b-8f4a-2149fea63403 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:33.730357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 504/1019] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:33.735303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87505a-975c-4d24-bf64-3c9da942cb7f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:33.735590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87505a-975c-4d24-bf64-3c9da942cb7f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:33.735867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87505a-975c-4d24-bf64-3c9da942cb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:33.754360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5e87505a-975c-4d24-bf64-3c9da942cb7f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:33.755548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5e87505a-975c-4d24-bf64-3c9da942cb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:33.826433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 516/1020] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:33.937333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90a11-2641-484b-8f4a-2149fea63403 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.043140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90a11-2641-484b-8f4a-2149fea63403 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.056392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:34.079121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.079750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.080038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.080300 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] PATH_INFO: `/v3/services/image` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.080884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.082234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:34.090943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:34.091941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:34.092823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:34.094882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87505a-975c-4d24-bf64-3c9da942cb7f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.096968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 505/1021] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Sep 1 08:03:33 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:34.097677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.200832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87505a-975c-4d24-bf64-3c9da942cb7f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.203906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9a07f-536b-4a45-886b-8242f7dcc40b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.216040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:34.239144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de935d6-1274-44e1-9296-ca47050f2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.239780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de935d6-1274-44e1-9296-ca47050f2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.240061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de935d6-1274-44e1-9296-ca47050f2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.240397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de935d6-1274-44e1-9296-ca47050f2bf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.241434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de935d6-1274-44e1-9296-ca47050f2bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.241741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.242471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.242843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.242949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de935d6-1274-44e1-9296-ca47050f2bf9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.243552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.244282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] RBAC: Adding query filter params (name=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:34.245440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.245559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 517/1022] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:34.246864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.251070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de935d6-1274-44e1-9296-ca47050f2bf9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.254328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 506/1023] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:34.257848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.300490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:34.369016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de935d6-1274-44e1-9296-ca47050f2bf9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.369282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d32df-faed-4e2e-ad3b-ebdd05a95235 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.407471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3d91-ad77-423e-9a62-25f5b576a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.408207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3d91-ad77-423e-9a62-25f5b576a58d None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.408552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3d91-ad77-423e-9a62-25f5b576a58d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.408895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3d91-ad77-423e-9a62-25f5b576a58d None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.409615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc3d91-ad77-423e-9a62-25f5b576a58d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.410189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.410902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.411256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.411367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc3d91-ad77-423e-9a62-25f5b576a58d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.411666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.412376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] RBAC: Adding query filter params (type=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:34.412752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.414181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.426080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 507/1024] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:34.426859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.451962 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 518/1025] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:34 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:34.573847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cdc96-e48e-4ae0-a49d-6ddd7009985e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.576851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:34.625000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cc8fa-dc77-457b-8d4a-bc847623e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.626001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc8fa-dc77-457b-8d4a-bc847623e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.626686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc8fa-dc77-457b-8d4a-bc847623e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.626959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc8fa-dc77-457b-8d4a-bc847623e2b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.627671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cc8fa-dc77-457b-8d4a-bc847623e2b5 None admin] RBAC: Adding query filter params (interface=public, service_id=f546e89bc73a49f1a7c0a2f560dd6e82, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:34.627980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cc8fa-dc77-457b-8d4a-bc847623e2b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.629344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cc8fa-dc77-457b-8d4a-bc847623e2b5 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.640251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 508/1026] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 08:03:34 2022] GET /identity/v3/endpoints?service_id=f546e89bc73a49f1a7c0a2f560dd6e82&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:34.650067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3d91-ad77-423e-9a62-25f5b576a58d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.690485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:34.746362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68b7dd-e44d-484c-a83f-746afc9a67c3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.747063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68b7dd-e44d-484c-a83f-746afc9a67c3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.747547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68b7dd-e44d-484c-a83f-746afc9a67c3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.748963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 509/1027] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:34.754907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800241-3af2-40c6-9e6b-51ca277779e7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.755368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800241-3af2-40c6-9e6b-51ca277779e7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.755654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba800241-3af2-40c6-9e6b-51ca277779e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.775456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ba800241-3af2-40c6-9e6b-51ca277779e7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:34.777333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ba800241-3af2-40c6-9e6b-51ca277779e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:34.780775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3d91-ad77-423e-9a62-25f5b576a58d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.821645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc1b3-e152-4529-bd10-6aff4f6993df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.822285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc1b3-e152-4529-bd10-6aff4f6993df None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.822574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc1b3-e152-4529-bd10-6aff4f6993df None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.822855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc1b3-e152-4529-bd10-6aff4f6993df None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.824349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbc1b3-e152-4529-bd10-6aff4f6993df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.825739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbc1b3-e152-4529-bd10-6aff4f6993df None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.832792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 519/1028] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:34 2022] GET /identity/v3/services => generated 1957 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:03:34.859463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 510/1029] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:35.141266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc1b3-e152-4529-bd10-6aff4f6993df None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:35.241630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:35.249780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc1b3-e152-4529-bd10-6aff4f6993df None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:35.284571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c79812-897d-44bc-a9ce-710849dac615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:35.285210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c79812-897d-44bc-a9ce-710849dac615 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:35.285492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c79812-897d-44bc-a9ce-710849dac615 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:35.285765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c79812-897d-44bc-a9ce-710849dac615 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:35.298913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c79812-897d-44bc-a9ce-710849dac615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c9c79812-897d-44bc-a9ce-710849dac615 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:35.303850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:35.305226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:35.306091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 520/1030] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:35.311636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba800241-3af2-40c6-9e6b-51ca277779e7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:35.420075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:35.424855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba800241-3af2-40c6-9e6b-51ca277779e7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:35.461975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:35.462625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:35.462909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:35.463186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:35.463888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:35.464194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:35.468459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:35.482343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 511/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:35.484377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c79812-897d-44bc-a9ce-710849dac615 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:35.586720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c79812-897d-44bc-a9ce-710849dac615 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:35.623071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:35.623703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:35.623982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:35.624252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:35.634919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:35.637382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:35.653594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:35.655315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:35.656237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:35.656237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:35.656237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:35.658673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 521/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:35.660827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:35.768391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa921104-4795-496a-93fb-d857db8cadc7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:35.802742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:35.803353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:35.803631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:35.803903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:35.804537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:35.804837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:35.806191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:35.823861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 512/1033] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:35.827251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:35.839527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:35.936978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6caf73-d2a0-4b94-97b2-c8866ced726b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:35.973625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:35.974286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:35.974567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:35.974843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:35.983214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:35.984798 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:35.996681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:35.997642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:35.999013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:36.002703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 522/1034] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:03:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:36.004021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:36.027809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:36.111002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044277a-4f12-4e03-911a-10d0fd47b154 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:36.145833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c3998-031b-411e-ac2c-1d734bb53044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:36.146471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c3998-031b-411e-ac2c-1d734bb53044 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.146749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c3998-031b-411e-ac2c-1d734bb53044 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.147016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c3998-031b-411e-ac2c-1d734bb53044 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.147738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c3998-031b-411e-ac2c-1d734bb53044 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:36.148039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c3998-031b-411e-ac2c-1d734bb53044 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:36.149440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c3998-031b-411e-ac2c-1d734bb53044 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:36.168118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 513/1035] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:03:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:36.173601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:36.243929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:36.281003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d4e84-3656-412a-9e70-8c39fde6a273 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:36.316222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2a65c-7689-4868-aaf1-3f7706f55f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:36.316834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2a65c-7689-4868-aaf1-3f7706f55f8e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.317113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2a65c-7689-4868-aaf1-3f7706f55f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.317391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2a65c-7689-4868-aaf1-3f7706f55f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.388058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2a65c-7689-4868-aaf1-3f7706f55f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:36.389514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2a65c-7689-4868-aaf1-3f7706f55f8e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:36.458959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:36.494113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2171760-f6f8-4df1-af1f-e0c469fc4be6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.494476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2171760-f6f8-4df1-af1f-e0c469fc4be6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.494767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2171760-f6f8-4df1-af1f-e0c469fc4be6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.496904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 514/1036] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:36.502738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 523/1037] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:36.503957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2a65c-7689-4868-aaf1-3f7706f55f8e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:36.504189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d68c-1653-4f95-9301-3dc6757a2f3c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.504472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d68c-1653-4f95-9301-3dc6757a2f3c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.504746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d68c-1653-4f95-9301-3dc6757a2f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.523267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a623d68c-1653-4f95-9301-3dc6757a2f3c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:36.524434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a623d68c-1653-4f95-9301-3dc6757a2f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:36.601072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 515/1038] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:36.613870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2a65c-7689-4868-aaf1-3f7706f55f8e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:36.648141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe17863-b562-40bb-ad7f-24869efaf4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:36.648771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe17863-b562-40bb-ad7f-24869efaf4ef None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.649048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe17863-b562-40bb-ad7f-24869efaf4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.649319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe17863-b562-40bb-ad7f-24869efaf4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.661461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe17863-b562-40bb-ad7f-24869efaf4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:36.662978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe17863-b562-40bb-ad7f-24869efaf4ef None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8fe17863-b562-40bb-ad7f-24869efaf4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:36.679030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:36.680062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:36.680999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:36.680999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:36.680999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:36.680999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 524/1039] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:36.687594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623d68c-1653-4f95-9301-3dc6757a2f3c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:36.701702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:36.794825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd337d5-6f92-4b1c-aa62-3bdc23dba623 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.795114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd337d5-6f92-4b1c-aa62-3bdc23dba623 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.795394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd337d5-6f92-4b1c-aa62-3bdc23dba623 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.796744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 525/1040] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:36.801816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e4f4-5431-4356-b704-35867d1edcd7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.802105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e4f4-5431-4356-b704-35867d1edcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.802418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e4f4-5431-4356-b704-35867d1edcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.808240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623d68c-1653-4f95-9301-3dc6757a2f3c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:36.825927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bea9e4f4-5431-4356-b704-35867d1edcd7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:36.827261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bea9e4f4-5431-4356-b704-35867d1edcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:36.843240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:36.849104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:36.849726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.850008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.850778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.851504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:36.851753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:36.853127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:36.865476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 516/1041] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:36.872544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:36.899438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 526/1042] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:36.900303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9e4f4-5431-4356-b704-35867d1edcd7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:36.944040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:36.998973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80e3e6-c072-42fe-8797-ef2827865f18 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.008767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9e4f4-5431-4356-b704-35867d1edcd7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.036353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.036993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.037277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.037554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.045073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.046530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.047383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc4ba-87b7-418a-b5d5-e2bfd8efdf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.048181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc4ba-87b7-418a-b5d5-e2bfd8efdf29 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.048459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc4ba-87b7-418a-b5d5-e2bfd8efdf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.048753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc4ba-87b7-418a-b5d5-e2bfd8efdf29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.049829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc4ba-87b7-418a-b5d5-e2bfd8efdf29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.051300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc4ba-87b7-418a-b5d5-e2bfd8efdf29 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.052921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 527/1043] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:37.059044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc4ba-87b7-418a-b5d5-e2bfd8efdf29 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:37.059449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:37.060346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:37.061299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:37.061299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:37.061299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:37.061299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:37.061299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:37.061299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:37.061299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:37.061299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:37.065312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 517/1044] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:37.066402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.080040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:37.180193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc4ba-87b7-418a-b5d5-e2bfd8efdf29 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.182151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c8569-1131-4a27-9d7a-e155628d0f68 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.210213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:37.217614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15f64-c4ee-4279-9545-fb1d8465063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.218238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15f64-c4ee-4279-9545-fb1d8465063c None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.218546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15f64-c4ee-4279-9545-fb1d8465063c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.218824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15f64-c4ee-4279-9545-fb1d8465063c None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.219498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf15f64-c4ee-4279-9545-fb1d8465063c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.219620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.220209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.220488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.220759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.220928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf15f64-c4ee-4279-9545-fb1d8465063c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.221445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:37.221748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.223168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.236937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 518/1045] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:37.237779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.248448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 528/1046] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:03:37 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:37.249256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15f64-c4ee-4279-9545-fb1d8465063c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.343699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:37.374493 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15f64-c4ee-4279-9545-fb1d8465063c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.390756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da3e8b-2c63-4de7-b5c9-84bb9409768a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.420066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.420282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.420524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.422078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.422078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] RBAC: Adding query filter params (role.id=78930e293ae84688884690c965f65053, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=7949d9285d4e4c908c377a0ac16dd14d) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:37.422078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.423283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.429648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 529/1047] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/role_assignments?user.id=7949d9285d4e4c908c377a0ac16dd14d&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=78930e293ae84688884690c965f65053 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:37.442374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.442374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.442374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.442374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] PATH_INFO: `/v3/services/image` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.442788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.444208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:37.455237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:37.456514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:37.457422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 519/1048] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/services/image => generated 86 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:37.463010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.593946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f4bd-f81e-4877-841d-41dbc1682a78 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.632369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.633056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.633292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.633540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.634181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] RBAC: Adding query filter params (name=image) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:37.634516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.636102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.641782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 530/1049] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:37.647680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.705706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:37.761396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486972f-3d30-4ed4-a66b-cfe5aa602a81 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.799162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ade18-e657-437d-a532-8bccd3cb3209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.799775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ade18-e657-437d-a532-8bccd3cb3209 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.800018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ade18-e657-437d-a532-8bccd3cb3209 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.800296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ade18-e657-437d-a532-8bccd3cb3209 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.800936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ade18-e657-437d-a532-8bccd3cb3209 None admin] RBAC: Adding query filter params (type=image) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:37.801298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ade18-e657-437d-a532-8bccd3cb3209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.802650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ade18-e657-437d-a532-8bccd3cb3209 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.809900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 520/1050] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:37.814421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.817850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:37.928707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f789d0-7c96-48a8-9fce-e6d937afd913 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.965548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8166-a55c-4357-be6d-4be352838b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.966097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8166-a55c-4357-be6d-4be352838b89 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.966408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8166-a55c-4357-be6d-4be352838b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.966683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8166-a55c-4357-be6d-4be352838b89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.967375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde8166-a55c-4357-be6d-4be352838b89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.968753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde8166-a55c-4357-be6d-4be352838b89 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.991655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 531/1051] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:39.296103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585cb2-8c0d-4ca5-bf56-c81fa5465372 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:39.296625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585cb2-8c0d-4ca5-bf56-c81fa5465372 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:39.296703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585cb2-8c0d-4ca5-bf56-c81fa5465372 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:39.298030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 521/1052] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:39.303154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433dc1-9254-4593-91d4-77f9fea2fa71 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:39.303568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433dc1-9254-4593-91d4-77f9fea2fa71 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:39.303729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433dc1-9254-4593-91d4-77f9fea2fa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:39.322316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7c433dc1-9254-4593-91d4-77f9fea2fa71 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:39.323546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7c433dc1-9254-4593-91d4-77f9fea2fa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:39.376885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:39.398131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 532/1053] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:39.412248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdf3b-3461-4935-b4d6-3dd92942da2c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:39.412541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdf3b-3461-4935-b4d6-3dd92942da2c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:39.412800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdf3b-3461-4935-b4d6-3dd92942da2c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:39.414149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 522/1054] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:39.420155 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c116f5-6b8b-4a3c-8c33-6295a2c1ae67 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:39.420444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c116f5-6b8b-4a3c-8c33-6295a2c1ae67 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:39.420717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c116f5-6b8b-4a3c-8c33-6295a2c1ae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:39.441320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-39c116f5-6b8b-4a3c-8c33-6295a2c1ae67 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:39.442937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-39c116f5-6b8b-4a3c-8c33-6295a2c1ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:39.518312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 533/1055] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:39.672072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cdf3b-3461-4935-b4d6-3dd92942da2c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:39.778146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cdf3b-3461-4935-b4d6-3dd92942da2c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:39.790945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c116f5-6b8b-4a3c-8c33-6295a2c1ae67 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:39.795855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:39.815675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded6452-b392-4f6e-ba52-00588745acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:39.816365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6452-b392-4f6e-ba52-00588745acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:39.816589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6452-b392-4f6e-ba52-00588745acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:39.816862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6452-b392-4f6e-ba52-00588745acb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:39.831315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded6452-b392-4f6e-ba52-00588745acb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3ded6452-b392-4f6e-ba52-00588745acb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:39.836941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:39.837881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:39.844945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 523/1056] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:39.845685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded6452-b392-4f6e-ba52-00588745acb1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:39.903098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c116f5-6b8b-4a3c-8c33-6295a2c1ae67 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:39.919520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:39.943251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4b7c6-6527-481f-90ee-f0753aed718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:39.944014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4b7c6-6527-481f-90ee-f0753aed718d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:39.944300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4b7c6-6527-481f-90ee-f0753aed718d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:39.944576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4b7c6-6527-481f-90ee-f0753aed718d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:39.958386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4b7c6-6527-481f-90ee-f0753aed718d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c3d4b7c6-6527-481f-90ee-f0753aed718d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:39.963607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:39.964978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:39.966281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 534/1057] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:39.969848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c29b0-dc21-4104-bc84-93112aa4dc02 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:39.970144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c29b0-dc21-4104-bc84-93112aa4dc02 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:39.970470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c29b0-dc21-4104-bc84-93112aa4dc02 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:39.971664 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded6452-b392-4f6e-ba52-00588745acb1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:39.972386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 535/1058] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:39.973100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c29b0-dc21-4104-bc84-93112aa4dc02 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.009460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe75fdf-aa39-4ef8-a0f6-e3c4073e7476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.010068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe75fdf-aa39-4ef8-a0f6-e3c4073e7476 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.010947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe75fdf-aa39-4ef8-a0f6-e3c4073e7476 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.011191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe75fdf-aa39-4ef8-a0f6-e3c4073e7476 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.011864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe75fdf-aa39-4ef8-a0f6-e3c4073e7476 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:40.012167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe75fdf-aa39-4ef8-a0f6-e3c4073e7476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.013537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe75fdf-aa39-4ef8-a0f6-e3c4073e7476 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.022210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 524/1059] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:40.028581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263011-b17d-4770-b934-71cabef6b1d0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.028876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263011-b17d-4770-b934-71cabef6b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.029152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263011-b17d-4770-b934-71cabef6b1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.047779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6c263011-b17d-4770-b934-71cabef6b1d0 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:40.048977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6c263011-b17d-4770-b934-71cabef6b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:40.080293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.095183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c29b0-dc21-4104-bc84-93112aa4dc02 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.122047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 525/1060] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:40.123158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263011-b17d-4770-b934-71cabef6b1d0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.137880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.138757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.139212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.139657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.140551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:40.141003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.142625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.152477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 536/1061] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:40.158704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.197518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.234142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263011-b17d-4770-b934-71cabef6b1d0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.271194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb81d60-7a4e-44ab-824f-e57a072016fa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.272352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf243ed-f4a9-4f7c-8026-6fb0a834ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.272999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf243ed-f4a9-4f7c-8026-6fb0a834ac9f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.273278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf243ed-f4a9-4f7c-8026-6fb0a834ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.273543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf243ed-f4a9-4f7c-8026-6fb0a834ac9f None admin] PATH_INFO: `/v3/users/8c336d028d7243009b4a9b641c672b4e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.288447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf243ed-f4a9-4f7c-8026-6fb0a834ac9f None admin] RBAC: Authorizing `identity:get_user(user_id=8c336d028d7243009b4a9b641c672b4e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.289885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf243ed-f4a9-4f7c-8026-6fb0a834ac9f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.292638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 526/1062] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/users/8c336d028d7243009b4a9b641c672b4e => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:40.299725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf243ed-f4a9-4f7c-8026-6fb0a834ac9f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.321883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.322817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.323139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.323409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.327079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.335324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.337581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:40.354097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:40.355809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:40.356775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:40.356775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:40.356775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:40.356775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 537/1063] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:40.362010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.409505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf243ed-f4a9-4f7c-8026-6fb0a834ac9f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.446561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264fbe-66ab-4ab7-add2-856f1f892427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.447182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264fbe-66ab-4ab7-add2-856f1f892427 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.447463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264fbe-66ab-4ab7-add2-856f1f892427 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.447788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264fbe-66ab-4ab7-add2-856f1f892427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.455983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.470558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813d191-95a5-481e-9f03-85d26c12f184 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.506973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.507586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.507865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.508142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.508783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:40.509080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.510497 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.521788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d264fbe-66ab-4ab7-add2-856f1f892427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.522795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 538/1064] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:40.523365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d264fbe-66ab-4ab7-add2-856f1f892427 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.523480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.551702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.630557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 527/1065] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 08:03:40.631419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264fbe-66ab-4ab7-add2-856f1f892427 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.634066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ea2d0-e49c-4dff-9892-68b1caf26ef0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.670439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563fec7-e25e-4811-b828-1c4541e90f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.671058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563fec7-e25e-4811-b828-1c4541e90f18 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.671325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563fec7-e25e-4811-b828-1c4541e90f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.671597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563fec7-e25e-4811-b828-1c4541e90f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.689855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.738560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264fbe-66ab-4ab7-add2-856f1f892427 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.741999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563fec7-e25e-4811-b828-1c4541e90f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.743764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563fec7-e25e-4811-b828-1c4541e90f18 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.766745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.776139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.776779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.777062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.777339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.785291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.786772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:40.799275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:40.800354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 528/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:40.801390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.854755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 539/1067] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:40.854755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563fec7-e25e-4811-b828-1c4541e90f18 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.905780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.916056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e39d3-0c9d-4528-9988-4474f105c158 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.951837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2b87-1c48-42c0-925b-3aa4c6e8b2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.952459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2b87-1c48-42c0-925b-3aa4c6e8b2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.952743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2b87-1c48-42c0-925b-3aa4c6e8b2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.953015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2b87-1c48-42c0-925b-3aa4c6e8b2d6 None admin] PATH_INFO: `/v3/projects/65cc56f65bf54a2ba08c7390101a4214` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.954140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c2b87-1c48-42c0-925b-3aa4c6e8b2d6 None admin] RBAC: Authorizing `identity:get_project(project_id=65cc56f65bf54a2ba08c7390101a4214)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.955596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c2b87-1c48-42c0-925b-3aa4c6e8b2d6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.957218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 529/1068] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/projects/65cc56f65bf54a2ba08c7390101a4214 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:40.957976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2b87-1c48-42c0-925b-3aa4c6e8b2d6 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.959821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563fec7-e25e-4811-b828-1c4541e90f18 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.002526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.003060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.003345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.003623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.005390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:41.005707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.007210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.019281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:41.026281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 540/1069] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:41.027309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:41.070844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2b87-1c48-42c0-925b-3aa4c6e8b2d6 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.109751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.110437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.110721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.111004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.123339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.124819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.139788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331355c-9f07-4157-b71b-b01d1f88de1d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:41.140708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:41.142421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:41.143798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:41.143798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:41.143798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:41.143798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 530/1070] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:41.143798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:41.148560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:41.178712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.179343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.179620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.179898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.180644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=65cc56f65bf54a2ba08c7390101a4214, user.id=8c336d028d7243009b4a9b641c672b4e) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:41.180959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.183060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.188986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 541/1071] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:41 2022] GET /identity/v3/role_assignments?user.id=8c336d028d7243009b4a9b641c672b4e&scope.project.id=65cc56f65bf54a2ba08c7390101a4214&role.id=b76f0bbd02794923b10af161becac1c6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:41.189825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:41.271407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ae3ed-a22e-4c42-9ea0-d57283c106a0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.280341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:41.309109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779bc32-09dd-4d74-aa76-17da93575992 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.320310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.321412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.321705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.322156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.335576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.337028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:41.354772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:41.355837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:41.356762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:41.356762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:41.356762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:41.356938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.356938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.356938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.356938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.357563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:41.357563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.358669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.360868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 531/1072] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:41.361777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:41.372044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 542/1073] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:41.494000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90b084-04e6-4c1f-a30f-788aff15332f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.538029 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.538724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.539011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.539283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.539933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:41.540244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.541677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.556422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 532/1074] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:41.562534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:41.598352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:41.678563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9bd65-ca31-4372-8980-60321dbfb699 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.716295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.716937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.717218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.717490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.724349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.725775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:41.737952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:41.739150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:41.740151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 543/1075] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:41.745763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:41.765926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:41.844807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6a8b2-3076-4694-b6a4-4e8d29df3edd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.879607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01007c04-1108-407d-af5a-8658a5b4ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.880207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01007c04-1108-407d-af5a-8658a5b4ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.880488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01007c04-1108-407d-af5a-8658a5b4ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.880758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01007c04-1108-407d-af5a-8658a5b4ba66 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.881438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01007c04-1108-407d-af5a-8658a5b4ba66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:41.881747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01007c04-1108-407d-af5a-8658a5b4ba66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.883191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01007c04-1108-407d-af5a-8658a5b4ba66 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.894921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 533/1076] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:41.900837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:41.989158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:41.998992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc102-3bd1-4c4f-ac05-e63a2df88242 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:42.031569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6b23-169b-48fe-a2d7-f23fa991d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:42.032216 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6b23-169b-48fe-a2d7-f23fa991d5c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:42.032494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6b23-169b-48fe-a2d7-f23fa991d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:42.032763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6b23-169b-48fe-a2d7-f23fa991d5c0 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/7949d9285d4e4c908c377a0ac16dd14d/roles/78930e293ae84688884690c965f65053` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:42.034883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6b23-169b-48fe-a2d7-f23fa991d5c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=7949d9285d4e4c908c377a0ac16dd14d, role_id=78930e293ae84688884690c965f65053)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:42.036299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6b23-169b-48fe-a2d7-f23fa991d5c0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:42.049275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 544/1077] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:41 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/7949d9285d4e4c908c377a0ac16dd14d/roles/78930e293ae84688884690c965f65053 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:03:43.142136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73dbd7-f6dd-4a2f-8dab-fa453da42f79 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.142789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73dbd7-f6dd-4a2f-8dab-fa453da42f79 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.142789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73dbd7-f6dd-4a2f-8dab-fa453da42f79 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.144053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 534/1078] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:43.149448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b53a0-8a23-473b-bb52-245895ca1208 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.149899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b53a0-8a23-473b-bb52-245895ca1208 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.150168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b53a0-8a23-473b-bb52-245895ca1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.183540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b70b53a0-8a23-473b-bb52-245895ca1208 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:43.184745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b70b53a0-8a23-473b-bb52-245895ca1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:43.252117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 545/1079] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:43.521074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73dbd7-f6dd-4a2f-8dab-fa453da42f79 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:43.603767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:43.629777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73dbd7-f6dd-4a2f-8dab-fa453da42f79 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:43.665124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c4d4-cfab-4bb3-9e82-d22e2917699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:43.665755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c4d4-cfab-4bb3-9e82-d22e2917699d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.666032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c4d4-cfab-4bb3-9e82-d22e2917699d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.666332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c4d4-cfab-4bb3-9e82-d22e2917699d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.676973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c4d4-cfab-4bb3-9e82-d22e2917699d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-9de1c4d4-cfab-4bb3-9e82-d22e2917699d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:43.681733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:43.683048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:43.683895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 535/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:43.688857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b53a0-8a23-473b-bb52-245895ca1208 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:43.780225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:43.801633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b53a0-8a23-473b-bb52-245895ca1208 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:43.837923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf564828-33ff-4dc6-9735-db33e5e43589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:43.839116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf564828-33ff-4dc6-9735-db33e5e43589 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.839593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf564828-33ff-4dc6-9735-db33e5e43589 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.839931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf564828-33ff-4dc6-9735-db33e5e43589 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.840607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf564828-33ff-4dc6-9735-db33e5e43589 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:43.840918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf564828-33ff-4dc6-9735-db33e5e43589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:43.842311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf564828-33ff-4dc6-9735-db33e5e43589 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:43.851445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 546/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:43.857993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c4d4-cfab-4bb3-9e82-d22e2917699d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:43.942983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90c7a-1af8-4b52-8a67-6e4bd3e4870e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.943268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90c7a-1af8-4b52-8a67-6e4bd3e4870e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.943545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90c7a-1af8-4b52-8a67-6e4bd3e4870e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.944879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 547/1082] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:43.950664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510809-581a-4254-aee9-009a489b8e70 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.950944 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510809-581a-4254-aee9-009a489b8e70 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.951253 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60510809-581a-4254-aee9-009a489b8e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.965155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c4d4-cfab-4bb3-9e82-d22e2917699d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:43.969642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-60510809-581a-4254-aee9-009a489b8e70 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:43.970854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-60510809-581a-4254-aee9-009a489b8e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:44.001382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463cf29-0913-4ecc-9745-fa3c2fd8377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.001826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463cf29-0913-4ecc-9745-fa3c2fd8377d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.002109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463cf29-0913-4ecc-9745-fa3c2fd8377d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.002409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463cf29-0913-4ecc-9745-fa3c2fd8377d None admin] PATH_INFO: `/v3/users/8c336d028d7243009b4a9b641c672b4e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.003556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463cf29-0913-4ecc-9745-fa3c2fd8377d None admin] RBAC: Authorizing `identity:get_user(user_id=8c336d028d7243009b4a9b641c672b4e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:44.004988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463cf29-0913-4ecc-9745-fa3c2fd8377d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:44.006627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 536/1083] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:43 2022] GET /identity/v3/users/8c336d028d7243009b4a9b641c672b4e => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:44.014461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463cf29-0913-4ecc-9745-fa3c2fd8377d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:44.024948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:44.052783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 548/1084] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:44.120699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463cf29-0913-4ecc-9745-fa3c2fd8377d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:44.157723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a94dc-9930-4c7d-8a1a-64277fbfdbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.158405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a94dc-9930-4c7d-8a1a-64277fbfdbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.158648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a94dc-9930-4c7d-8a1a-64277fbfdbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.158921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a94dc-9930-4c7d-8a1a-64277fbfdbb9 None admin] PATH_INFO: `/v3/projects/65cc56f65bf54a2ba08c7390101a4214` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.160032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a94dc-9930-4c7d-8a1a-64277fbfdbb9 None admin] RBAC: Authorizing `identity:get_project(project_id=65cc56f65bf54a2ba08c7390101a4214)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:44.161462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a94dc-9930-4c7d-8a1a-64277fbfdbb9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:44.163105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 537/1085] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:44 2022] GET /identity/v3/projects/65cc56f65bf54a2ba08c7390101a4214 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:44.169621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60510809-581a-4254-aee9-009a489b8e70 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:44.241585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:44.273059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60510809-581a-4254-aee9-009a489b8e70 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:44.307183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cdd43-7012-487e-b3ff-1f5cf506e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.308448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cdd43-7012-487e-b3ff-1f5cf506e10d None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.308725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cdd43-7012-487e-b3ff-1f5cf506e10d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.308995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cdd43-7012-487e-b3ff-1f5cf506e10d None admin] PATH_INFO: `/v3/projects/65cc56f65bf54a2ba08c7390101a4214/users/8c336d028d7243009b4a9b641c672b4e/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.310905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cdd43-7012-487e-b3ff-1f5cf506e10d None admin] RBAC: Authorizing `identity:create_grant(project_id=65cc56f65bf54a2ba08c7390101a4214, user_id=8c336d028d7243009b4a9b641c672b4e, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:44.312327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cdd43-7012-487e-b3ff-1f5cf506e10d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:44.324651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a94dc-9930-4c7d-8a1a-64277fbfdbb9 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:44.326775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 549/1086] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:44 2022] PUT /identity/v3/projects/65cc56f65bf54a2ba08c7390101a4214/users/8c336d028d7243009b4a9b641c672b4e/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:03:44.414070 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:44.447183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a94dc-9930-4c7d-8a1a-64277fbfdbb9 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:44.488552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30aac9-7bfe-4ffa-9a66-f83be1f687c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.489212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30aac9-7bfe-4ffa-9a66-f83be1f687c4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.489498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30aac9-7bfe-4ffa-9a66-f83be1f687c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.489775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30aac9-7bfe-4ffa-9a66-f83be1f687c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.504751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30aac9-7bfe-4ffa-9a66-f83be1f687c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5a30aac9-7bfe-4ffa-9a66-f83be1f687c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:44.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:44.511100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:44.512238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 538/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:44.517523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cdd43-7012-487e-b3ff-1f5cf506e10d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:44.626662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cdd43-7012-487e-b3ff-1f5cf506e10d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:44.656162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:44.662149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.662802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.663333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.663770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.664680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:44.664990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:44.666390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:44.675889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 550/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:44.681605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30aac9-7bfe-4ffa-9a66-f83be1f687c4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:44.782607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30aac9-7bfe-4ffa-9a66-f83be1f687c4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:44.816508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.817136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.817413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.817682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.819641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:44.829473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:44.830960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:44.845217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:44.846292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:44.847314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:44.847314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:44.847314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:44.847314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 539/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:44.852243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:44.953106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6b3a-e4f6-4182-a759-f02874a16564 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:44.987387 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.987992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.988275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.988550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.989190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:44.989494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:44.990893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:45.002805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 551/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:45.008448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:45.107522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629022e-5da2-464a-af8f-ddd47875b2cc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:45.140108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:45.140726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:45.141002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:45.141269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:45.148370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:45.149791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:45.161137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:45.168334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:03:45.169909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 540/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 08:03:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:45.172051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:45.227904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:45.275428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e671f32-dcdf-4753-88c0-2cb9a3a4c473 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:45.308791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:45.309404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:45.309686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:45.309959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:45.310749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:45.311055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:45.312464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:45.330133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 552/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 08:03:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:45.336062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:45.385120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:45.439659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767aaf-e9f1-4d34-ad20-749a07cc4ff3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:45.476008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24a2ae-92c3-4af3-ac3d-7374d800cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:45.476619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24a2ae-92c3-4af3-ac3d-7374d800cc40 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:45.476897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24a2ae-92c3-4af3-ac3d-7374d800cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:45.477167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24a2ae-92c3-4af3-ac3d-7374d800cc40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:45.546896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24a2ae-92c3-4af3-ac3d-7374d800cc40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:45.548342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24a2ae-92c3-4af3-ac3d-7374d800cc40 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:45.592547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:45.647109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 541/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:45.652861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:45.753341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb1901-ed76-4bd6-b6f9-edc0a9d2d263 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:45.767324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:45.788663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:45.789294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:45.789573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:45.789849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:45.800507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:45.801869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:45.816770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:45.817872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:45.818853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:45.818853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:45.818853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:45.818853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 553/1094] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:45.823807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24a2ae-92c3-4af3-ac3d-7374d800cc40 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:45.921688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24a2ae-92c3-4af3-ac3d-7374d800cc40 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:45.955440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:45.956047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:45.956327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:45.956599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:45.957236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:45.957540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:45.958934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:45.970178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 542/1095] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:45.975908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:46.081178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe3c6-acd5-468a-bae2-c530234d7607 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:46.114512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a711c8-3317-4dae-ac98-9af959e8f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:46.115135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a711c8-3317-4dae-ac98-9af959e8f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.115416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a711c8-3317-4dae-ac98-9af959e8f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.115689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a711c8-3317-4dae-ac98-9af959e8f8b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.122605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a711c8-3317-4dae-ac98-9af959e8f8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:46.124042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a711c8-3317-4dae-ac98-9af959e8f8b9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f5a711c8-3317-4dae-ac98-9af959e8f8b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:46.135085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:46.136531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:46.137633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 554/1096] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:46.142703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:46.153262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:46.246755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e197-5b75-4d1c-91b7-bbdacfb0eee7 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:46.280461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:46.281065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.281350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.281619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.282398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:46.282706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:46.284153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:46.296235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 543/1097] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:46.300637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a87981-0e8d-4cc5-a5f8-b08aa08f4fa1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.301124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a87981-0e8d-4cc5-a5f8-b08aa08f4fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.301228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a87981-0e8d-4cc5-a5f8-b08aa08f4fa1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.302331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:46.302611 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 555/1098] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:46.308587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc90b-e65c-4f8a-a719-948a3b997208 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.308875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc90b-e65c-4f8a-a719-948a3b997208 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.309424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc90b-e65c-4f8a-a719-948a3b997208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.327980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a60fc90b-e65c-4f8a-a719-948a3b997208 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:46.329168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a60fc90b-e65c-4f8a-a719-948a3b997208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:46.346941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:46.368918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:46.399997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 556/1099] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:46.406899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567ff64-1ad4-453c-927e-69a6b8119ba8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:46.445999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:46.446655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.446940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.447214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.448514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] RBAC: Adding query filter params (role.id=78930e293ae84688884690c965f65053, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=7949d9285d4e4c908c377a0ac16dd14d) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:46.449012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:46.450480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:46.456627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 544/1100] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:46 2022] GET /identity/v3/role_assignments?user.id=7949d9285d4e4c908c377a0ac16dd14d&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=78930e293ae84688884690c965f65053 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:46.670337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc90b-e65c-4f8a-a719-948a3b997208 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:46.777922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc90b-e65c-4f8a-a719-948a3b997208 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:46.822219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094784ce-2bb5-4306-b944-b1e3f452844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:46.823279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094784ce-2bb5-4306-b944-b1e3f452844d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.823625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094784ce-2bb5-4306-b944-b1e3f452844d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.823915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094784ce-2bb5-4306-b944-b1e3f452844d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.834931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094784ce-2bb5-4306-b944-b1e3f452844d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-094784ce-2bb5-4306-b944-b1e3f452844d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:46.839936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:46.840925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:03:46.841833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 557/1101] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:46.847343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:46.960468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348f85-856c-47f8-b5c1-e4741e3629b8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:46.989742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:46.997137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:46.997763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.998044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.998353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.999025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:46.999334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:47.000706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:47.010038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 545/1102] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:47.016849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094784ce-2bb5-4306-b944-b1e3f452844d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:47.035379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:47.142025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094784ce-2bb5-4306-b944-b1e3f452844d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:47.181808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43dadd-6c3f-4efa-aeec-9eee30013cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:47.182625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43dadd-6c3f-4efa-aeec-9eee30013cec None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:47.183128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43dadd-6c3f-4efa-aeec-9eee30013cec None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:47.183435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43dadd-6c3f-4efa-aeec-9eee30013cec None admin] PATH_INFO: `/v3/users/8c336d028d7243009b4a9b641c672b4e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:47.184657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43dadd-6c3f-4efa-aeec-9eee30013cec None admin] RBAC: Authorizing `identity:get_user(user_id=8c336d028d7243009b4a9b641c672b4e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:47.186134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43dadd-6c3f-4efa-aeec-9eee30013cec None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:47.188118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 558/1103] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:47 2022] GET /identity/v3/users/8c336d028d7243009b4a9b641c672b4e => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:47.194143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:47.307367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739cf2d-e140-4412-ac5f-9f75e01f20bc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:47.345002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd8c3c-8e14-4cf5-aad3-db1ac1cb988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:47.345617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd8c3c-8e14-4cf5-aad3-db1ac1cb988d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:47.345898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd8c3c-8e14-4cf5-aad3-db1ac1cb988d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:47.346176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd8c3c-8e14-4cf5-aad3-db1ac1cb988d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:47.403977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:47.413911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd8c3c-8e14-4cf5-aad3-db1ac1cb988d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:47.415412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd8c3c-8e14-4cf5-aad3-db1ac1cb988d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:47.514852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 546/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:47.520759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43dadd-6c3f-4efa-aeec-9eee30013cec None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:47.601717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:47.622479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43dadd-6c3f-4efa-aeec-9eee30013cec None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:47.655712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c017-f58a-4833-b7ad-047e06e06108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:47.656327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c017-f58a-4833-b7ad-047e06e06108 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:47.656605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c017-f58a-4833-b7ad-047e06e06108 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:47.656878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c017-f58a-4833-b7ad-047e06e06108 None admin] PATH_INFO: `/v3/projects/65cc56f65bf54a2ba08c7390101a4214` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:47.657964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c017-f58a-4833-b7ad-047e06e06108 None admin] RBAC: Authorizing `identity:get_project(project_id=65cc56f65bf54a2ba08c7390101a4214)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:47.659422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c017-f58a-4833-b7ad-047e06e06108 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:47.661051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 559/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:47 2022] GET /identity/v3/projects/65cc56f65bf54a2ba08c7390101a4214 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:47.667751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd8c3c-8e14-4cf5-aad3-db1ac1cb988d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:47.758861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:47.767555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd8c3c-8e14-4cf5-aad3-db1ac1cb988d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:47.801088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ed4f7-e9ec-4ffc-9890-2c184cba9dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:47.801682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed4f7-e9ec-4ffc-9890-2c184cba9dfc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:47.801959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed4f7-e9ec-4ffc-9890-2c184cba9dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:47.802230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed4f7-e9ec-4ffc-9890-2c184cba9dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:47.802974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ed4f7-e9ec-4ffc-9890-2c184cba9dfc None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=65cc56f65bf54a2ba08c7390101a4214, user.id=8c336d028d7243009b4a9b641c672b4e) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:47.803280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ed4f7-e9ec-4ffc-9890-2c184cba9dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:47.804692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ed4f7-e9ec-4ffc-9890-2c184cba9dfc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:47.810377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 547/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:47 2022] GET /identity/v3/role_assignments?user.id=8c336d028d7243009b4a9b641c672b4e&scope.project.id=65cc56f65bf54a2ba08c7390101a4214&role.id=b76f0bbd02794923b10af161becac1c6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:49.743744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb6b40-f0e7-42be-b77a-0ad697c1d116 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:49.744251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb6b40-f0e7-42be-b77a-0ad697c1d116 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:49.744251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb6b40-f0e7-42be-b77a-0ad697c1d116 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:49.746306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 560/1107] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:49.752198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf028-81f5-4769-bf5f-51478371f908 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:49.752679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf028-81f5-4769-bf5f-51478371f908 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:49.752769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf028-81f5-4769-bf5f-51478371f908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:49.770685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-926cf028-81f5-4769-bf5f-51478371f908 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:49.771871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-926cf028-81f5-4769-bf5f-51478371f908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:49.841524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 548/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:50.112072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb6b40-f0e7-42be-b77a-0ad697c1d116 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:50.211628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb6b40-f0e7-42be-b77a-0ad697c1d116 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:50.244277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dab675-8a2c-468c-9da9-b1ac9d860f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:50.245513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab675-8a2c-468c-9da9-b1ac9d860f89 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:50.245866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab675-8a2c-468c-9da9-b1ac9d860f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:50.246142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dab675-8a2c-468c-9da9-b1ac9d860f89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:50.247268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dab675-8a2c-468c-9da9-b1ac9d860f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:50.248737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dab675-8a2c-468c-9da9-b1ac9d860f89 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:50.250351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 561/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:50.256173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cf028-81f5-4769-bf5f-51478371f908 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:50.339855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:50.354775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cf028-81f5-4769-bf5f-51478371f908 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:50.394520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed5ebd-e79c-4341-8155-0243f9a8aa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:50.395032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed5ebd-e79c-4341-8155-0243f9a8aa84 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:50.395375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed5ebd-e79c-4341-8155-0243f9a8aa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:50.395652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed5ebd-e79c-4341-8155-0243f9a8aa84 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:50.396314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed5ebd-e79c-4341-8155-0243f9a8aa84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:50.399980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed5ebd-e79c-4341-8155-0243f9a8aa84 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:50.422289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 549/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:03:50 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:52.404067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4457-2330-452c-be67-34663fecd340 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:52.404605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4457-2330-452c-be67-34663fecd340 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:52.404605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d4457-2330-452c-be67-34663fecd340 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:52.405962 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 562/1111] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:52.411792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79702f8-fcc8-4ae8-b079-e7ad1c47251d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:52.412235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79702f8-fcc8-4ae8-b079-e7ad1c47251d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:52.412337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79702f8-fcc8-4ae8-b079-e7ad1c47251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:52.430519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a79702f8-fcc8-4ae8-b079-e7ad1c47251d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:52.431720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a79702f8-fcc8-4ae8-b079-e7ad1c47251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:52.502907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 550/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:52.773123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d4457-2330-452c-be67-34663fecd340 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:52.793543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:52.879804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d4457-2330-452c-be67-34663fecd340 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:52.913930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5b2f-0ea3-4ab7-901a-5f7de3c92f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:52.914590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5b2f-0ea3-4ab7-901a-5f7de3c92f9a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:52.914872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5b2f-0ea3-4ab7-901a-5f7de3c92f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:52.915152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5b2f-0ea3-4ab7-901a-5f7de3c92f9a None admin] PATH_INFO: `/v3/roles/664110d895074b5a89855c373f794807` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:52.917118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5b2f-0ea3-4ab7-901a-5f7de3c92f9a None admin] RBAC: Authorizing `identity:get_role(role_id=664110d895074b5a89855c373f794807)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:52.918914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5b2f-0ea3-4ab7-901a-5f7de3c92f9a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:52.920259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 563/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:52 2022] GET /identity/v3/roles/664110d895074b5a89855c373f794807 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:52.926097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79702f8-fcc8-4ae8-b079-e7ad1c47251d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:52.996898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:53.027766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79702f8-fcc8-4ae8-b079-e7ad1c47251d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:53.062608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab1518-bdc2-499a-a7bd-81a83c0daccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:53.063225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab1518-bdc2-499a-a7bd-81a83c0daccc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:53.063502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab1518-bdc2-499a-a7bd-81a83c0daccc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:53.063772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab1518-bdc2-499a-a7bd-81a83c0daccc None admin] PATH_INFO: `/v3/users/16f5d2d2b98f46a7b5e9418af8c7f1d7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:53.076657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab1518-bdc2-499a-a7bd-81a83c0daccc None admin] RBAC: Authorizing `identity:get_user(user_id=16f5d2d2b98f46a7b5e9418af8c7f1d7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:53.078084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab1518-bdc2-499a-a7bd-81a83c0daccc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:53.079739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 551/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:52 2022] GET /identity/v3/users/16f5d2d2b98f46a7b5e9418af8c7f1d7 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:53.085590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5b2f-0ea3-4ab7-901a-5f7de3c92f9a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:53.174709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:53.190284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5b2f-0ea3-4ab7-901a-5f7de3c92f9a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:53.225523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf1dc6-d73c-4ea0-8331-b81be681c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:53.226134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf1dc6-d73c-4ea0-8331-b81be681c17c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:53.226452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf1dc6-d73c-4ea0-8331-b81be681c17c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:53.226730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf1dc6-d73c-4ea0-8331-b81be681c17c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:53.297257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf1dc6-d73c-4ea0-8331-b81be681c17c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:53.298781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf1dc6-d73c-4ea0-8331-b81be681c17c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:53.388957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:53.405289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 564/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:53.411313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab1518-bdc2-499a-a7bd-81a83c0daccc None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:53.512143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab1518-bdc2-499a-a7bd-81a83c0daccc None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:53.540206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:53.546221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666e802-a984-48b1-bf91-f910baf1e255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:53.546883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e802-a984-48b1-bf91-f910baf1e255 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:53.547163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e802-a984-48b1-bf91-f910baf1e255 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:53.547482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e802-a984-48b1-bf91-f910baf1e255 None admin] PATH_INFO: `/v3/projects/65cc56f65bf54a2ba08c7390101a4214` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:53.548527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666e802-a984-48b1-bf91-f910baf1e255 None admin] RBAC: Authorizing `identity:get_project(project_id=65cc56f65bf54a2ba08c7390101a4214)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:53.549933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666e802-a984-48b1-bf91-f910baf1e255 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:53.551621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 552/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:53 2022] GET /identity/v3/projects/65cc56f65bf54a2ba08c7390101a4214 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:53.557988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf1dc6-d73c-4ea0-8331-b81be681c17c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:53.656728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf1dc6-d73c-4ea0-8331-b81be681c17c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:53.690017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae640d5-104d-4d3d-ba7c-adf6479074c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:53.690643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae640d5-104d-4d3d-ba7c-adf6479074c8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:53.690920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae640d5-104d-4d3d-ba7c-adf6479074c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:53.691188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae640d5-104d-4d3d-ba7c-adf6479074c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:53.691903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae640d5-104d-4d3d-ba7c-adf6479074c8 None admin] RBAC: Adding query filter params (role.id=664110d895074b5a89855c373f794807, scope.project.id=65cc56f65bf54a2ba08c7390101a4214, user.id=16f5d2d2b98f46a7b5e9418af8c7f1d7) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:53.692211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae640d5-104d-4d3d-ba7c-adf6479074c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:53.693626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae640d5-104d-4d3d-ba7c-adf6479074c8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:53.699593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 565/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:53 2022] GET /identity/v3/role_assignments?user.id=16f5d2d2b98f46a7b5e9418af8c7f1d7&scope.project.id=65cc56f65bf54a2ba08c7390101a4214&role.id=664110d895074b5a89855c373f794807 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:55.583365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754273c7-2268-417c-a52b-7337aac59c21 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:55.583894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754273c7-2268-417c-a52b-7337aac59c21 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:55.583894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754273c7-2268-417c-a52b-7337aac59c21 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:55.585251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 553/1118] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:55.592043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66260e6-ece4-4ffc-8ee0-4501af119f87 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:55.592542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66260e6-ece4-4ffc-8ee0-4501af119f87 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:55.592996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66260e6-ece4-4ffc-8ee0-4501af119f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:55.615438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c66260e6-ece4-4ffc-8ee0-4501af119f87 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:55.616642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c66260e6-ece4-4ffc-8ee0-4501af119f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:55.665128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:55.686391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 566/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:55.956154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754273c7-2268-417c-a52b-7337aac59c21 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:56.059775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754273c7-2268-417c-a52b-7337aac59c21 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:56.094248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0701e24-1339-4c20-9ebc-b2958248ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:56.094897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701e24-1339-4c20-9ebc-b2958248ba1f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:56.095180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701e24-1339-4c20-9ebc-b2958248ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:56.095459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701e24-1339-4c20-9ebc-b2958248ba1f None admin] PATH_INFO: `/v3/roles/664110d895074b5a89855c373f794807` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:56.096826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0701e24-1339-4c20-9ebc-b2958248ba1f None admin] RBAC: Authorizing `identity:get_role(role_id=664110d895074b5a89855c373f794807)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:56.098180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0701e24-1339-4c20-9ebc-b2958248ba1f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:56.099540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 554/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:55 2022] GET /identity/v3/roles/664110d895074b5a89855c373f794807 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:56.106087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66260e6-ece4-4ffc-8ee0-4501af119f87 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:56.208758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66260e6-ece4-4ffc-8ee0-4501af119f87 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:56.242558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3b728-7cff-48a3-b9a5-7932e87e2f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:56.243445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b728-7cff-48a3-b9a5-7932e87e2f61 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:56.243726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b728-7cff-48a3-b9a5-7932e87e2f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:56.243998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b728-7cff-48a3-b9a5-7932e87e2f61 None admin] PATH_INFO: `/v3/users/16f5d2d2b98f46a7b5e9418af8c7f1d7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:56.245680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3b728-7cff-48a3-b9a5-7932e87e2f61 None admin] RBAC: Authorizing `identity:get_user(user_id=16f5d2d2b98f46a7b5e9418af8c7f1d7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:56.247153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3b728-7cff-48a3-b9a5-7932e87e2f61 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:56.248723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 567/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:56 2022] GET /identity/v3/users/16f5d2d2b98f46a7b5e9418af8c7f1d7 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:56.254675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0701e24-1339-4c20-9ebc-b2958248ba1f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:56.320464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:56.357719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0701e24-1339-4c20-9ebc-b2958248ba1f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:56.394459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48a198-0253-4c6b-a1f7-e8c70557aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:56.395099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48a198-0253-4c6b-a1f7-e8c70557aea8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:56.395378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48a198-0253-4c6b-a1f7-e8c70557aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:56.395655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48a198-0253-4c6b-a1f7-e8c70557aea8 None admin] PATH_INFO: `/v3/projects/65cc56f65bf54a2ba08c7390101a4214` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:56.396808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48a198-0253-4c6b-a1f7-e8c70557aea8 None admin] RBAC: Authorizing `identity:get_project(project_id=65cc56f65bf54a2ba08c7390101a4214)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:56.398249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48a198-0253-4c6b-a1f7-e8c70557aea8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:56.399959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 555/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:56 2022] GET /identity/v3/projects/65cc56f65bf54a2ba08c7390101a4214 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:56.406426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3b728-7cff-48a3-b9a5-7932e87e2f61 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:56.459018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:56.515898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3b728-7cff-48a3-b9a5-7932e87e2f61 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:56.549681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a166482-5fb8-494f-a942-533fb5111f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:56.550359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166482-5fb8-494f-a942-533fb5111f82 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:56.550640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166482-5fb8-494f-a942-533fb5111f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:56.550910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a166482-5fb8-494f-a942-533fb5111f82 None admin] PATH_INFO: `/v3/projects/65cc56f65bf54a2ba08c7390101a4214/users/16f5d2d2b98f46a7b5e9418af8c7f1d7/roles/664110d895074b5a89855c373f794807` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:56.552995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a166482-5fb8-494f-a942-533fb5111f82 None admin] RBAC: Authorizing `identity:create_grant(project_id=65cc56f65bf54a2ba08c7390101a4214, user_id=16f5d2d2b98f46a7b5e9418af8c7f1d7, role_id=664110d895074b5a89855c373f794807)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:56.554436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a166482-5fb8-494f-a942-533fb5111f82 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:56.566993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 568/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:56 2022] PUT /identity/v3/projects/65cc56f65bf54a2ba08c7390101a4214/users/16f5d2d2b98f46a7b5e9418af8c7f1d7/roles/664110d895074b5a89855c373f794807 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:03:58.476130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41745-e5e3-4816-9631-013c579ef4f6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:58.476519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41745-e5e3-4816-9631-013c579ef4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:58.476686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41745-e5e3-4816-9631-013c579ef4f6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:58.478031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 556/1124] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:58.483377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03727bb-7d8c-490e-a88f-766f44df67f6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:58.483763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03727bb-7d8c-490e-a88f-766f44df67f6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:58.483927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03727bb-7d8c-490e-a88f-766f44df67f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:58.502435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a03727bb-7d8c-490e-a88f-766f44df67f6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:58.503613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a03727bb-7d8c-490e-a88f-766f44df67f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:58.569117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 569/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:58.835230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41745-e5e3-4816-9631-013c579ef4f6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:58.939536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41745-e5e3-4816-9631-013c579ef4f6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:58.974454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fa81a-2763-4335-9090-2d4443251a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:58.975077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa81a-2763-4335-9090-2d4443251a96 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:58.975357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa81a-2763-4335-9090-2d4443251a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:58.976150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa81a-2763-4335-9090-2d4443251a96 None admin] PATH_INFO: `/v3/roles/664110d895074b5a89855c373f794807` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:58.977036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fa81a-2763-4335-9090-2d4443251a96 None admin] RBAC: Authorizing `identity:get_role(role_id=664110d895074b5a89855c373f794807)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:58.978418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fa81a-2763-4335-9090-2d4443251a96 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:58.979782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 557/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:58 2022] GET /identity/v3/roles/664110d895074b5a89855c373f794807 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:58.985620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03727bb-7d8c-490e-a88f-766f44df67f6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:59.027456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.095906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03727bb-7d8c-490e-a88f-766f44df67f6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:59.132892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af46767-9ab6-42c9-81d2-c6738fd91b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:59.133517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af46767-9ab6-42c9-81d2-c6738fd91b84 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:59.133800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af46767-9ab6-42c9-81d2-c6738fd91b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:59.134076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af46767-9ab6-42c9-81d2-c6738fd91b84 None admin] PATH_INFO: `/v3/users/16f5d2d2b98f46a7b5e9418af8c7f1d7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:59.135246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af46767-9ab6-42c9-81d2-c6738fd91b84 None admin] RBAC: Authorizing `identity:get_user(user_id=16f5d2d2b98f46a7b5e9418af8c7f1d7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:59.136677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af46767-9ab6-42c9-81d2-c6738fd91b84 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:59.138268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 570/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:58 2022] GET /identity/v3/users/16f5d2d2b98f46a7b5e9418af8c7f1d7 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:59.144086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fa81a-2763-4335-9090-2d4443251a96 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:59.146966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.246280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fa81a-2763-4335-9090-2d4443251a96 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:59.281000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8ebc3-d515-4715-8d4e-e139d80bc0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:59.281605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ebc3-d515-4715-8d4e-e139d80bc0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:59.281886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ebc3-d515-4715-8d4e-e139d80bc0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:59.282208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8ebc3-d515-4715-8d4e-e139d80bc0b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:59.352602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8ebc3-d515-4715-8d4e-e139d80bc0b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:59.354602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8ebc3-d515-4715-8d4e-e139d80bc0b0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:59.356801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.459616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 558/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:59.466240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af46767-9ab6-42c9-81d2-c6738fd91b84 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:59.582745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af46767-9ab6-42c9-81d2-c6738fd91b84 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:59.590790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.620339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0414b9-5d73-49d3-8d35-08669c0ca9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:59.620897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0414b9-5d73-49d3-8d35-08669c0ca9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:59.621174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0414b9-5d73-49d3-8d35-08669c0ca9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:59.621446 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0414b9-5d73-49d3-8d35-08669c0ca9f4 None admin] PATH_INFO: `/v3/projects/65cc56f65bf54a2ba08c7390101a4214` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:59.622591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0414b9-5d73-49d3-8d35-08669c0ca9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=65cc56f65bf54a2ba08c7390101a4214)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:59.624008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0414b9-5d73-49d3-8d35-08669c0ca9f4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:59.625653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 571/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:59 2022] GET /identity/v3/projects/65cc56f65bf54a2ba08c7390101a4214 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:59.631958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8ebc3-d515-4715-8d4e-e139d80bc0b0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:59.739769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8ebc3-d515-4715-8d4e-e139d80bc0b0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:59.741800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.783384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00d548-8be6-4354-9b2b-20a49f7edae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:59.783992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00d548-8be6-4354-9b2b-20a49f7edae0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:59.784269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00d548-8be6-4354-9b2b-20a49f7edae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:59.784538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00d548-8be6-4354-9b2b-20a49f7edae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:59.785268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00d548-8be6-4354-9b2b-20a49f7edae0 None admin] RBAC: Adding query filter params (role.id=664110d895074b5a89855c373f794807, scope.project.id=65cc56f65bf54a2ba08c7390101a4214, user.id=16f5d2d2b98f46a7b5e9418af8c7f1d7) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:59.785574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00d548-8be6-4354-9b2b-20a49f7edae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:59.787083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00d548-8be6-4354-9b2b-20a49f7edae0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:59.793824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 559/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:59 2022] GET /identity/v3/role_assignments?user.id=16f5d2d2b98f46a7b5e9418af8c7f1d7&scope.project.id=65cc56f65bf54a2ba08c7390101a4214&role.id=664110d895074b5a89855c373f794807 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:04:01.740672 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121208-4663-49cb-b2e4-c8100d994de7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:01.741176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121208-4663-49cb-b2e4-c8100d994de7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:01.741286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121208-4663-49cb-b2e4-c8100d994de7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:01.743361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 572/1131] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:01.749676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ec3eb-05f1-4074-9c60-c8452a35a0ce None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:01.750129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ec3eb-05f1-4074-9c60-c8452a35a0ce None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:01.750218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ec3eb-05f1-4074-9c60-c8452a35a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:01.768904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7d0ec3eb-05f1-4074-9c60-c8452a35a0ce None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:01.770110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7d0ec3eb-05f1-4074-9c60-c8452a35a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:01.836485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 560/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:02.123121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121208-4663-49cb-b2e4-c8100d994de7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:02.246641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121208-4663-49cb-b2e4-c8100d994de7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:02.284481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54de7c-85ef-4ae6-8a10-e5c2163f32c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:02.285433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54de7c-85ef-4ae6-8a10-e5c2163f32c6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:02.285721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54de7c-85ef-4ae6-8a10-e5c2163f32c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:02.285995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54de7c-85ef-4ae6-8a10-e5c2163f32c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:02.287156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54de7c-85ef-4ae6-8a10-e5c2163f32c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:02.288586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54de7c-85ef-4ae6-8a10-e5c2163f32c6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:02.290157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 573/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:04:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:02.297595 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ec3eb-05f1-4074-9c60-c8452a35a0ce None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:02.414717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:02.422589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ec3eb-05f1-4074-9c60-c8452a35a0ce None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:02.463654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6352d-8b28-408b-ab9e-ec23852d0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:02.464595 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6352d-8b28-408b-ab9e-ec23852d0893 None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:02.464980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6352d-8b28-408b-ab9e-ec23852d0893 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:02.465302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6352d-8b28-408b-ab9e-ec23852d0893 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:02.465985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6352d-8b28-408b-ab9e-ec23852d0893 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:02.467478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6352d-8b28-408b-ab9e-ec23852d0893 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:02.500976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 561/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:04:02 2022] POST /identity/v3/projects => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:04:04.509921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd851e4-cb22-4f38-b7e3-30a553f2ed0a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:04.511143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd851e4-cb22-4f38-b7e3-30a553f2ed0a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:04.511326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd851e4-cb22-4f38-b7e3-30a553f2ed0a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:04.512693 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 574/1135] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:04.517794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48c6f-d76e-4fba-a83a-e3b2f399a8a5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:04.518206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48c6f-d76e-4fba-a83a-e3b2f399a8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:04.518369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48c6f-d76e-4fba-a83a-e3b2f399a8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:04.537039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3ad48c6f-d76e-4fba-a83a-e3b2f399a8a5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:04.538225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3ad48c6f-d76e-4fba-a83a-e3b2f399a8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:04.608770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 562/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:04.877001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd851e4-cb22-4f38-b7e3-30a553f2ed0a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:04.921139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:04.978249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd851e4-cb22-4f38-b7e3-30a553f2ed0a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:05.011858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8a04d-9ce5-4ddd-af9e-6ad0c35c1fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:05.012483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8a04d-9ce5-4ddd-af9e-6ad0c35c1fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:05.012764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8a04d-9ce5-4ddd-af9e-6ad0c35c1fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:05.013039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8a04d-9ce5-4ddd-af9e-6ad0c35c1fc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:05.014139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8a04d-9ce5-4ddd-af9e-6ad0c35c1fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:05.015599 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8a04d-9ce5-4ddd-af9e-6ad0c35c1fc2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:05.017160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 575/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:04:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:05.022935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48c6f-d76e-4fba-a83a-e3b2f399a8a5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:05.107648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:05.134283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48c6f-d76e-4fba-a83a-e3b2f399a8a5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:05.169597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f618df5-fb83-481d-baab-c4261c136cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:05.170196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f618df5-fb83-481d-baab-c4261c136cdf None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:05.170505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f618df5-fb83-481d-baab-c4261c136cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:05.170780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f618df5-fb83-481d-baab-c4261c136cdf None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:05.171424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f618df5-fb83-481d-baab-c4261c136cdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:05.172849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f618df5-fb83-481d-baab-c4261c136cdf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:05.194555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 563/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:04:05 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:04:07.196726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f705734-6c0f-44b3-8a85-89643da3e552 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:07.197276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f705734-6c0f-44b3-8a85-89643da3e552 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:07.197276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f705734-6c0f-44b3-8a85-89643da3e552 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:07.199534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 576/1139] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:07.204741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703387-55ab-4051-984f-c01454643281 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:07.205165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703387-55ab-4051-984f-c01454643281 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:07.205305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703387-55ab-4051-984f-c01454643281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:07.223598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-93703387-55ab-4051-984f-c01454643281 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:07.224796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-93703387-55ab-4051-984f-c01454643281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:07.296593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 564/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:07.567282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f705734-6c0f-44b3-8a85-89643da3e552 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:07.672217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f705734-6c0f-44b3-8a85-89643da3e552 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:07.683655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:07.708144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb80de-6ceb-4fb2-8d22-72a3f7c137cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:07.708779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb80de-6ceb-4fb2-8d22-72a3f7c137cb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:07.709064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb80de-6ceb-4fb2-8d22-72a3f7c137cb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:07.709340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb80de-6ceb-4fb2-8d22-72a3f7c137cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:07.722491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb80de-6ceb-4fb2-8d22-72a3f7c137cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c6eb80de-6ceb-4fb2-8d22-72a3f7c137cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:07.727271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:07.728455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:04:07.730428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 577/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:07.735123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93703387-55ab-4051-984f-c01454643281 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:07.798487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:07.838390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93703387-55ab-4051-984f-c01454643281 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:07.873170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:07.873775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:07.874061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:07.874362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:07.875226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:07.875397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:07.877099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:07.886558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 565/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:04:07.892490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb80de-6ceb-4fb2-8d22-72a3f7c137cb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:08.000326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb80de-6ceb-4fb2-8d22-72a3f7c137cb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:08.035484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34473c35-a0f5-47b7-ae5f-58c0b7225e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:08.036120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34473c35-a0f5-47b7-ae5f-58c0b7225e36 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:08.036401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34473c35-a0f5-47b7-ae5f-58c0b7225e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:08.036677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34473c35-a0f5-47b7-ae5f-58c0b7225e36 None admin] PATH_INFO: `/v3/users/f9dbc426b5c54d3d985ff53fc55f1d1c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:08.050694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34473c35-a0f5-47b7-ae5f-58c0b7225e36 None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbc426b5c54d3d985ff53fc55f1d1c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:08.052142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34473c35-a0f5-47b7-ae5f-58c0b7225e36 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:08.053796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 578/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:07 2022] GET /identity/v3/users/f9dbc426b5c54d3d985ff53fc55f1d1c => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:08.059947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:08.160591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2828cc-3af6-4a09-a01a-35001d0ba369 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:08.185853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:08.194558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16788e9f-24cc-4e64-8511-ca35661e1a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:08.195162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16788e9f-24cc-4e64-8511-ca35661e1a5a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:08.195441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16788e9f-24cc-4e64-8511-ca35661e1a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:08.195710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16788e9f-24cc-4e64-8511-ca35661e1a5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:08.264129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16788e9f-24cc-4e64-8511-ca35661e1a5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:08.265609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16788e9f-24cc-4e64-8511-ca35661e1a5a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:08.360858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 566/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:04:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:04:08.366896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34473c35-a0f5-47b7-ae5f-58c0b7225e36 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:08.395052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:08.466826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34473c35-a0f5-47b7-ae5f-58c0b7225e36 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:08.499909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649ddea-494e-45a8-aafb-8152d2a67964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:08.500529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ddea-494e-45a8-aafb-8152d2a67964 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:08.500807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ddea-494e-45a8-aafb-8152d2a67964 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:08.501076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ddea-494e-45a8-aafb-8152d2a67964 None admin] PATH_INFO: `/v3/projects/cc0c92f9ddb244ae9bb81deed6035b54` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:08.502172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649ddea-494e-45a8-aafb-8152d2a67964 None admin] RBAC: Authorizing `identity:get_project(project_id=cc0c92f9ddb244ae9bb81deed6035b54)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:08.503633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649ddea-494e-45a8-aafb-8152d2a67964 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:08.505219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 579/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:08 2022] GET /identity/v3/projects/cc0c92f9ddb244ae9bb81deed6035b54 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:08.511986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16788e9f-24cc-4e64-8511-ca35661e1a5a None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:08.538888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:08.611616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16788e9f-24cc-4e64-8511-ca35661e1a5a None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:08.644913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb5396-8ca1-437d-b1c1-a1c9e20a1aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:08.645501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb5396-8ca1-437d-b1c1-a1c9e20a1aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:08.645780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb5396-8ca1-437d-b1c1-a1c9e20a1aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:08.646047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb5396-8ca1-437d-b1c1-a1c9e20a1aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:08.646785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb5396-8ca1-437d-b1c1-a1c9e20a1aa9 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=cc0c92f9ddb244ae9bb81deed6035b54, user.id=f9dbc426b5c54d3d985ff53fc55f1d1c) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:08.647087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb5396-8ca1-437d-b1c1-a1c9e20a1aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:08.648495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb5396-8ca1-437d-b1c1-a1c9e20a1aa9 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:08.654278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 567/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:04:08 2022] GET /identity/v3/role_assignments?user.id=f9dbc426b5c54d3d985ff53fc55f1d1c&scope.project.id=cc0c92f9ddb244ae9bb81deed6035b54&role.id=b76f0bbd02794923b10af161becac1c6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:10.553612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab968-8890-4063-bdb7-af72c38e866b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:10.554134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab968-8890-4063-bdb7-af72c38e866b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:10.554226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab968-8890-4063-bdb7-af72c38e866b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:10.555546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 580/1147] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:10.561339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173df1ea-f659-4973-9bee-d46603d499b1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:10.561848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173df1ea-f659-4973-9bee-d46603d499b1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:10.561935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173df1ea-f659-4973-9bee-d46603d499b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:10.581653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-173df1ea-f659-4973-9bee-d46603d499b1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:10.582912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-173df1ea-f659-4973-9bee-d46603d499b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:10.656499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 568/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:10.921820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab968-8890-4063-bdb7-af72c38e866b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:11.016327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:11.023589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab968-8890-4063-bdb7-af72c38e866b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:11.058476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38547f-519d-491a-8f78-093954debe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:11.059103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38547f-519d-491a-8f78-093954debe86 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:11.059380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38547f-519d-491a-8f78-093954debe86 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:11.059652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38547f-519d-491a-8f78-093954debe86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:11.069840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38547f-519d-491a-8f78-093954debe86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4f38547f-519d-491a-8f78-093954debe86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:11.075150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:11.076295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:04:11.077445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 581/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:11.082315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173df1ea-f659-4973-9bee-d46603d499b1 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:11.105220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:11.187031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173df1ea-f659-4973-9bee-d46603d499b1 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:11.222502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:11.223122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:11.223398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:11.223670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:11.224329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:11.224629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:11.225991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:11.235194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 569/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:11.241117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38547f-519d-491a-8f78-093954debe86 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:11.345205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38547f-519d-491a-8f78-093954debe86 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:11.378628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec06d2-097f-4afe-9767-82c7baf85b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:11.379246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec06d2-097f-4afe-9767-82c7baf85b1d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:11.379528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec06d2-097f-4afe-9767-82c7baf85b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:11.379805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec06d2-097f-4afe-9767-82c7baf85b1d None admin] PATH_INFO: `/v3/users/f9dbc426b5c54d3d985ff53fc55f1d1c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:11.380908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec06d2-097f-4afe-9767-82c7baf85b1d None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbc426b5c54d3d985ff53fc55f1d1c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:11.382355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec06d2-097f-4afe-9767-82c7baf85b1d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:11.383909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 582/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:11 2022] GET /identity/v3/users/f9dbc426b5c54d3d985ff53fc55f1d1c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:11.391418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:11.473310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:11.491091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558fc27-e897-4d2d-9ddd-92435d7dabb1 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:11.523954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ddcbe-fd33-4036-bbb0-de8ba219dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:11.524573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ddcbe-fd33-4036-bbb0-de8ba219dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:11.524856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ddcbe-fd33-4036-bbb0-de8ba219dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:11.525130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ddcbe-fd33-4036-bbb0-de8ba219dcd4 None admin] PATH_INFO: `/v3/projects/cc0c92f9ddb244ae9bb81deed6035b54` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:11.526883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ddcbe-fd33-4036-bbb0-de8ba219dcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=cc0c92f9ddb244ae9bb81deed6035b54)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:11.528296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ddcbe-fd33-4036-bbb0-de8ba219dcd4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:11.529907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 570/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:11 2022] GET /identity/v3/projects/cc0c92f9ddb244ae9bb81deed6035b54 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:11.536079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec06d2-097f-4afe-9767-82c7baf85b1d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:11.561484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:11.640774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec06d2-097f-4afe-9767-82c7baf85b1d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:11.674967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f35f40-38e9-41ff-806b-bffb8669ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:11.675636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35f40-38e9-41ff-806b-bffb8669ca20 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:11.675921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35f40-38e9-41ff-806b-bffb8669ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:11.676199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35f40-38e9-41ff-806b-bffb8669ca20 None admin] PATH_INFO: `/v3/projects/cc0c92f9ddb244ae9bb81deed6035b54/users/f9dbc426b5c54d3d985ff53fc55f1d1c/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:11.678200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f35f40-38e9-41ff-806b-bffb8669ca20 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc0c92f9ddb244ae9bb81deed6035b54, user_id=f9dbc426b5c54d3d985ff53fc55f1d1c, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:11.679709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f35f40-38e9-41ff-806b-bffb8669ca20 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:11.694470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 583/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:04:11 2022] PUT /identity/v3/projects/cc0c92f9ddb244ae9bb81deed6035b54/users/f9dbc426b5c54d3d985ff53fc55f1d1c/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:04:13.593789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ac25-fb8c-4092-8806-a6c55a8e276e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:13.594517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ac25-fb8c-4092-8806-a6c55a8e276e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:13.594517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ac25-fb8c-4092-8806-a6c55a8e276e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:13.595763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 571/1154] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:13.601189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129b08-5b27-4f11-8e46-9cd3d481afd2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:13.601700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129b08-5b27-4f11-8e46-9cd3d481afd2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:13.601824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129b08-5b27-4f11-8e46-9cd3d481afd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:13.620198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-56129b08-5b27-4f11-8e46-9cd3d481afd2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:13.621381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-56129b08-5b27-4f11-8e46-9cd3d481afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:13.687859 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 584/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:13.956651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6ac25-fb8c-4092-8806-a6c55a8e276e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:14.066930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6ac25-fb8c-4092-8806-a6c55a8e276e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:14.102890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4a84e-d48f-4ff9-8975-ed4a9bf79b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:14.103574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a84e-d48f-4ff9-8975-ed4a9bf79b43 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:14.104471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a84e-d48f-4ff9-8975-ed4a9bf79b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:14.104748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a84e-d48f-4ff9-8975-ed4a9bf79b43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:14.115766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4a84e-d48f-4ff9-8975-ed4a9bf79b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-cef4a84e-d48f-4ff9-8975-ed4a9bf79b43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:14.121302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:14.122544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:04:14.123476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 572/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:14.128529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56129b08-5b27-4f11-8e46-9cd3d481afd2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:14.143824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:14.229019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56129b08-5b27-4f11-8e46-9cd3d481afd2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:14.262931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:14.263539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:14.263823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:14.264101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:14.264759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:14.265066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:14.266458 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:14.274548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 585/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:14.281010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4a84e-d48f-4ff9-8975-ed4a9bf79b43 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:14.294861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:14.386061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4a84e-d48f-4ff9-8975-ed4a9bf79b43 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:14.419346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67720-ab6c-4b8d-a881-ea3676e81aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:14.419968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67720-ab6c-4b8d-a881-ea3676e81aaf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:14.420251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67720-ab6c-4b8d-a881-ea3676e81aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:14.420525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67720-ab6c-4b8d-a881-ea3676e81aaf None admin] PATH_INFO: `/v3/users/f9dbc426b5c54d3d985ff53fc55f1d1c` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:14.421626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe67720-ab6c-4b8d-a881-ea3676e81aaf None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbc426b5c54d3d985ff53fc55f1d1c)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:14.423076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe67720-ab6c-4b8d-a881-ea3676e81aaf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:14.424636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 573/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:14 2022] GET /identity/v3/users/f9dbc426b5c54d3d985ff53fc55f1d1c => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:14.430624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:14.509686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:14.532377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b595e7-4886-41e5-90cb-afde7ab8d29b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:14.565513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1c807-28e9-4d67-8ba1-584a3c40d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:14.566116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1c807-28e9-4d67-8ba1-584a3c40d29c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:14.566425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1c807-28e9-4d67-8ba1-584a3c40d29c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:14.566699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1c807-28e9-4d67-8ba1-584a3c40d29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:14.634115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1c807-28e9-4d67-8ba1-584a3c40d29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:14.635688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1c807-28e9-4d67-8ba1-584a3c40d29c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:14.706714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:14.731125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 586/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:04:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:04:14.737906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67720-ab6c-4b8d-a881-ea3676e81aaf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:14.821704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:14.843714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67720-ab6c-4b8d-a881-ea3676e81aaf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:14.876686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f39e6-d5d2-4a5e-af55-5dad3e9bc000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:14.877302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f39e6-d5d2-4a5e-af55-5dad3e9bc000 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:14.877580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f39e6-d5d2-4a5e-af55-5dad3e9bc000 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:14.877847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f39e6-d5d2-4a5e-af55-5dad3e9bc000 None admin] PATH_INFO: `/v3/projects/cc0c92f9ddb244ae9bb81deed6035b54` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:14.878950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f39e6-d5d2-4a5e-af55-5dad3e9bc000 None admin] RBAC: Authorizing `identity:get_project(project_id=cc0c92f9ddb244ae9bb81deed6035b54)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:14.880357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f39e6-d5d2-4a5e-af55-5dad3e9bc000 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:14.881957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 574/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:14 2022] GET /identity/v3/projects/cc0c92f9ddb244ae9bb81deed6035b54 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:14.888907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1c807-28e9-4d67-8ba1-584a3c40d29c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:14.986528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1c807-28e9-4d67-8ba1-584a3c40d29c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:15.020743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a59000-29f9-4d42-9b16-05379c3875c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:15.021340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a59000-29f9-4d42-9b16-05379c3875c4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:15.021622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a59000-29f9-4d42-9b16-05379c3875c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:15.021899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a59000-29f9-4d42-9b16-05379c3875c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:15.022647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a59000-29f9-4d42-9b16-05379c3875c4 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=cc0c92f9ddb244ae9bb81deed6035b54, user.id=f9dbc426b5c54d3d985ff53fc55f1d1c) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:15.022958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a59000-29f9-4d42-9b16-05379c3875c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:15.024371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a59000-29f9-4d42-9b16-05379c3875c4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:15.030274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 587/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:04:14 2022] GET /identity/v3/role_assignments?user.id=f9dbc426b5c54d3d985ff53fc55f1d1c&scope.project.id=cc0c92f9ddb244ae9bb81deed6035b54&role.id=b76f0bbd02794923b10af161becac1c6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:16.941342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a7e6-fd52-4d99-bac8-db0251e4d466 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:16.941890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a7e6-fd52-4d99-bac8-db0251e4d466 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:16.941890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a7e6-fd52-4d99-bac8-db0251e4d466 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:16.943244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 575/1162] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:16.949273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbc2d7-2fa0-4222-8ee5-e7b040a88d75 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:16.949735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbc2d7-2fa0-4222-8ee5-e7b040a88d75 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:16.949837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbc2d7-2fa0-4222-8ee5-e7b040a88d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:16.967569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-42cbc2d7-2fa0-4222-8ee5-e7b040a88d75 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:16.968751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-42cbc2d7-2fa0-4222-8ee5-e7b040a88d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:17.003786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:17.046905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 588/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:17.331353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139a7e6-fd52-4d99-bac8-db0251e4d466 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:17.437536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139a7e6-fd52-4d99-bac8-db0251e4d466 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:17.471917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c708e-79da-4b8e-b26b-24e91c0ea4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:17.472524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c708e-79da-4b8e-b26b-24e91c0ea4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:17.472802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c708e-79da-4b8e-b26b-24e91c0ea4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:17.473071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c708e-79da-4b8e-b26b-24e91c0ea4a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:17.488316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:17.544423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c708e-79da-4b8e-b26b-24e91c0ea4a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:17.545866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c708e-79da-4b8e-b26b-24e91c0ea4a4 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:17.642217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 576/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:04:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:04:17.648033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbc2d7-2fa0-4222-8ee5-e7b040a88d75 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:17.747588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbc2d7-2fa0-4222-8ee5-e7b040a88d75 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:17.781625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0b52d-7e6b-430f-9c0f-fd467445814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:17.782251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b52d-7e6b-430f-9c0f-fd467445814f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:17.782563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b52d-7e6b-430f-9c0f-fd467445814f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:17.782840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b52d-7e6b-430f-9c0f-fd467445814f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:17.789337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0b52d-7e6b-430f-9c0f-fd467445814f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:17.790834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0b52d-7e6b-430f-9c0f-fd467445814f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9ce0b52d-7e6b-430f-9c0f-fd467445814f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:17.802999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:17.804245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:04:17.805316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 589/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:04:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:17.810650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c708e-79da-4b8e-b26b-24e91c0ea4a4 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:17.855789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:17.907573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c708e-79da-4b8e-b26b-24e91c0ea4a4 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:17.940394 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b72705-4355-4333-bdaa-cc4af26d110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:17.940995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72705-4355-4333-bdaa-cc4af26d110a None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:17.941275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72705-4355-4333-bdaa-cc4af26d110a None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:17.941552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72705-4355-4333-bdaa-cc4af26d110a None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:17.942186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b72705-4355-4333-bdaa-cc4af26d110a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:17.942518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b72705-4355-4333-bdaa-cc4af26d110a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:17.943879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b72705-4355-4333-bdaa-cc4af26d110a None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:17.950860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 577/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 08:04:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:19.847848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead2956-a271-4e95-be00-e7a53d62d47f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:19.848400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead2956-a271-4e95-be00-e7a53d62d47f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:19.848400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead2956-a271-4e95-be00-e7a53d62d47f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:19.849726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 590/1167] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:19.855577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f385c-1c7d-4b41-975a-8d0f3b6e6588 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:19.856013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f385c-1c7d-4b41-975a-8d0f3b6e6588 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:19.856117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f385c-1c7d-4b41-975a-8d0f3b6e6588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:19.874869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-192f385c-1c7d-4b41-975a-8d0f3b6e6588 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:19.876050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-192f385c-1c7d-4b41-975a-8d0f3b6e6588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:19.942845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 578/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:20.212594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead2956-a271-4e95-be00-e7a53d62d47f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:20.245008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:20.316484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead2956-a271-4e95-be00-e7a53d62d47f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:20.350423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2849472-2a73-4b7b-8ecb-4ccb721b4329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:20.351035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849472-2a73-4b7b-8ecb-4ccb721b4329 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:20.351315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849472-2a73-4b7b-8ecb-4ccb721b4329 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:20.351590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849472-2a73-4b7b-8ecb-4ccb721b4329 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:20.352259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849472-2a73-4b7b-8ecb-4ccb721b4329 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:20.353618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2849472-2a73-4b7b-8ecb-4ccb721b4329 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:20.371023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 591/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Thu Sep 1 08:04:20 2022] POST /identity/v3/domains => generated 267 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:04:22.366558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91270a-e365-4eb4-be7d-0623c8c7d62a None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:22.367124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91270a-e365-4eb4-be7d-0623c8c7d62a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:22.367124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91270a-e365-4eb4-be7d-0623c8c7d62a None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:22.368692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 579/1170] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:22.374496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a469-20e9-4135-aa33-60146d569d81 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:22.374932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a469-20e9-4135-aa33-60146d569d81 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:22.375048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759a469-20e9-4135-aa33-60146d569d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:22.393734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4759a469-20e9-4135-aa33-60146d569d81 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:22.394979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4759a469-20e9-4135-aa33-60146d569d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:22.462909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 592/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:22.735654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91270a-e365-4eb4-be7d-0623c8c7d62a None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:22.778669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:22.836229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91270a-e365-4eb4-be7d-0623c8c7d62a None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:22.870501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab973e-bf5f-4d6d-985e-b1f91e4e1eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:22.871129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab973e-bf5f-4d6d-985e-b1f91e4e1eef None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:22.871402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab973e-bf5f-4d6d-985e-b1f91e4e1eef None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:22.871670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab973e-bf5f-4d6d-985e-b1f91e4e1eef None admin] PATH_INFO: `/v3/domains/6972965f2769427f92eccbb7853b075b` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:22.882096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab973e-bf5f-4d6d-985e-b1f91e4e1eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=6972965f2769427f92eccbb7853b075b)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:22.883571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab973e-bf5f-4d6d-985e-b1f91e4e1eef None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:22.885194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 580/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Sep 1 08:04:22 2022] GET /identity/v3/domains/6972965f2769427f92eccbb7853b075b => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:22.891115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759a469-20e9-4135-aa33-60146d569d81 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:22.912547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:22.992391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759a469-20e9-4135-aa33-60146d569d81 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:23.026562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40144241-9a36-46f9-ac57-3793011ce01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:23.027378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40144241-9a36-46f9-ac57-3793011ce01f None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:23.027661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40144241-9a36-46f9-ac57-3793011ce01f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:23.027934 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40144241-9a36-46f9-ac57-3793011ce01f None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:23.028595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40144241-9a36-46f9-ac57-3793011ce01f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:23.030022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40144241-9a36-46f9-ac57-3793011ce01f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:23.057989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 593/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:04:22 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:04:25.178488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428243-93df-48c9-aee7-3a9d80ef2555 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:25.179314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428243-93df-48c9-aee7-3a9d80ef2555 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:25.179314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428243-93df-48c9-aee7-3a9d80ef2555 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:25.180559 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 581/1174] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:25.186218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94b9e-86bc-4790-b01a-1ef2e993a86f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:25.186833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94b9e-86bc-4790-b01a-1ef2e993a86f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:25.186833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94b9e-86bc-4790-b01a-1ef2e993a86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:25.207305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-94c94b9e-86bc-4790-b01a-1ef2e993a86f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:25.208709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94c94b9e-86bc-4790-b01a-1ef2e993a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:25.305070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 594/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:25.592046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4428243-93df-48c9-aee7-3a9d80ef2555 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:25.704855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:25.709291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4428243-93df-48c9-aee7-3a9d80ef2555 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:25.746893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824440f1-2e04-4a1e-9b1f-d951af581149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:25.747450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824440f1-2e04-4a1e-9b1f-d951af581149 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:25.747728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824440f1-2e04-4a1e-9b1f-d951af581149 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:25.748003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824440f1-2e04-4a1e-9b1f-d951af581149 None admin] PATH_INFO: `/v3/domains/6972965f2769427f92eccbb7853b075b` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:25.749221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824440f1-2e04-4a1e-9b1f-d951af581149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6972965f2769427f92eccbb7853b075b)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:25.750778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824440f1-2e04-4a1e-9b1f-d951af581149 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:25.752350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 582/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Sep 1 08:04:25 2022] GET /identity/v3/domains/6972965f2769427f92eccbb7853b075b => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:25.759612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c94b9e-86bc-4790-b01a-1ef2e993a86f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:25.763246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:25.867651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c94b9e-86bc-4790-b01a-1ef2e993a86f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:25.919228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f342c8d-6cae-41b3-b644-46fe4cf4ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:25.919840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342c8d-6cae-41b3-b644-46fe4cf4ae91 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:25.920127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342c8d-6cae-41b3-b644-46fe4cf4ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:25.920451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342c8d-6cae-41b3-b644-46fe4cf4ae91 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:25.921195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f342c8d-6cae-41b3-b644-46fe4cf4ae91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:25.922700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f342c8d-6cae-41b3-b644-46fe4cf4ae91 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:25.949661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 595/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:04:25 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:04:27.983747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f009d-9a16-4292-b0a4-cb05a453cd0c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:27.984279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f009d-9a16-4292-b0a4-cb05a453cd0c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:27.984279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f009d-9a16-4292-b0a4-cb05a453cd0c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:27.985633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 583/1178] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:27.990946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e783-580b-4d40-be27-a46bb8fae1ed None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:27.991374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e783-580b-4d40-be27-a46bb8fae1ed None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:27.991496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e783-580b-4d40-be27-a46bb8fae1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:28.010083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8652e783-580b-4d40-be27-a46bb8fae1ed None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:28.011320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8652e783-580b-4d40-be27-a46bb8fae1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:28.063681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:28.078365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 596/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:28.344496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f009d-9a16-4292-b0a4-cb05a453cd0c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:28.450054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f009d-9a16-4292-b0a4-cb05a453cd0c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:28.486062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836621a6-a15d-482c-8830-b3649b6e3bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:28.486723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836621a6-a15d-482c-8830-b3649b6e3bef None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:28.487005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836621a6-a15d-482c-8830-b3649b6e3bef None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:28.487278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836621a6-a15d-482c-8830-b3649b6e3bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:28.499671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836621a6-a15d-482c-8830-b3649b6e3bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-836621a6-a15d-482c-8830-b3649b6e3bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:28.504434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:28.505690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:04:28.506814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 584/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:28.514197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652e783-580b-4d40-be27-a46bb8fae1ed None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:28.620513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652e783-580b-4d40-be27-a46bb8fae1ed None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:28.653875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:28.654516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:28.654793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:28.655066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:28.655735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:28.656035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:28.657404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:28.672097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 597/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:28.673950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836621a6-a15d-482c-8830-b3649b6e3bef None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:28.705939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:28.785861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836621a6-a15d-482c-8830-b3649b6e3bef None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:28.828936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e6b5-1377-4d36-915e-30cc1298518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:28.829571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e6b5-1377-4d36-915e-30cc1298518d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:28.829851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e6b5-1377-4d36-915e-30cc1298518d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:28.830120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e6b5-1377-4d36-915e-30cc1298518d None admin] PATH_INFO: `/v3/users/0bb59785b76b442fba33bb10ba076a1c` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:28.845620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e6b5-1377-4d36-915e-30cc1298518d None admin] RBAC: Authorizing `identity:get_user(user_id=0bb59785b76b442fba33bb10ba076a1c)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:28.847095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e6b5-1377-4d36-915e-30cc1298518d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:28.848761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 585/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:28 2022] GET /identity/v3/users/0bb59785b76b442fba33bb10ba076a1c => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:28.855083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:28.910345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:28.963753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce53da-4007-4f4c-87b8-202e3f9af80c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:29.002424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a1c5-de78-4ddc-b7a2-58ecedd7e7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:29.003186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a1c5-de78-4ddc-b7a2-58ecedd7e7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:29.003465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a1c5-de78-4ddc-b7a2-58ecedd7e7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:29.003736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a1c5-de78-4ddc-b7a2-58ecedd7e7f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:29.076299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a1c5-de78-4ddc-b7a2-58ecedd7e7f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:29.077929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a1c5-de78-4ddc-b7a2-58ecedd7e7f3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:29.127091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:29.179041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 598/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:04:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:04:29.185616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e6b5-1377-4d36-915e-30cc1298518d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:29.283172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:29.298747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e6b5-1377-4d36-915e-30cc1298518d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:29.333062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661803c-a13d-45ad-b7ad-9976f0e59673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:29.333696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661803c-a13d-45ad-b7ad-9976f0e59673 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:29.333981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661803c-a13d-45ad-b7ad-9976f0e59673 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:29.334282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661803c-a13d-45ad-b7ad-9976f0e59673 None admin] PATH_INFO: `/v3/projects/2b7fb182482041b49b0d3602bc1365a5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:29.335384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661803c-a13d-45ad-b7ad-9976f0e59673 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7fb182482041b49b0d3602bc1365a5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:29.336810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661803c-a13d-45ad-b7ad-9976f0e59673 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:29.339084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 586/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:29 2022] GET /identity/v3/projects/2b7fb182482041b49b0d3602bc1365a5 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:29.345463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a1c5-de78-4ddc-b7a2-58ecedd7e7f3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:29.469514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a1c5-de78-4ddc-b7a2-58ecedd7e7f3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:29.505303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee73ce-c826-426c-a012-5444f592a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:29.505969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee73ce-c826-426c-a012-5444f592a79c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:29.506252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee73ce-c826-426c-a012-5444f592a79c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:29.506559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee73ce-c826-426c-a012-5444f592a79c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:29.507294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee73ce-c826-426c-a012-5444f592a79c None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=2b7fb182482041b49b0d3602bc1365a5, user.id=0bb59785b76b442fba33bb10ba076a1c) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:29.507606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee73ce-c826-426c-a012-5444f592a79c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:29.509043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee73ce-c826-426c-a012-5444f592a79c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:29.516128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 599/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:04:29 2022] GET /identity/v3/role_assignments?user.id=0bb59785b76b442fba33bb10ba076a1c&scope.project.id=2b7fb182482041b49b0d3602bc1365a5&role.id=b76f0bbd02794923b10af161becac1c6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:31.441784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2619-5a58-4580-87dc-cd67d5754b5b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:31.442507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2619-5a58-4580-87dc-cd67d5754b5b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:31.442507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2619-5a58-4580-87dc-cd67d5754b5b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:31.443875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 587/1186] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:31.449779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950ad0-841d-494a-8dcb-07484b83125b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:31.450222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950ad0-841d-494a-8dcb-07484b83125b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:31.450351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950ad0-841d-494a-8dcb-07484b83125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:31.468385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d3950ad0-841d-494a-8dcb-07484b83125b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:31.469587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d3950ad0-841d-494a-8dcb-07484b83125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:31.479275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:31.536792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 600/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:31.807556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c2619-5a58-4580-87dc-cd67d5754b5b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:31.910397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c2619-5a58-4580-87dc-cd67d5754b5b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:31.945474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199d7af-31c0-45f3-998b-6489de1fa22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:31.946102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d7af-31c0-45f3-998b-6489de1fa22f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:31.946421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d7af-31c0-45f3-998b-6489de1fa22f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:31.946705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d7af-31c0-45f3-998b-6489de1fa22f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:31.957330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199d7af-31c0-45f3-998b-6489de1fa22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5199d7af-31c0-45f3-998b-6489de1fa22f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:31.962239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:31.963458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:04:31.967484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 588/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:31.969734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950ad0-841d-494a-8dcb-07484b83125b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:32.067708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950ad0-841d-494a-8dcb-07484b83125b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:32.102175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:32.102822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:32.103108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:32.103384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:32.104074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:32.104383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:32.105756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:32.113882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 601/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:32.121350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199d7af-31c0-45f3-998b-6489de1fa22f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:32.137607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:32.225590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199d7af-31c0-45f3-998b-6489de1fa22f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:32.261131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b5f59-4080-48d6-bcd8-36fec2cf6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:32.261752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5f59-4080-48d6-bcd8-36fec2cf6928 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:32.262032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5f59-4080-48d6-bcd8-36fec2cf6928 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:32.262326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5f59-4080-48d6-bcd8-36fec2cf6928 None admin] PATH_INFO: `/v3/users/0bb59785b76b442fba33bb10ba076a1c` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:32.263456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b5f59-4080-48d6-bcd8-36fec2cf6928 None admin] RBAC: Authorizing `identity:get_user(user_id=0bb59785b76b442fba33bb10ba076a1c)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:32.264872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b5f59-4080-48d6-bcd8-36fec2cf6928 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:32.266471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 589/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:32 2022] GET /identity/v3/users/0bb59785b76b442fba33bb10ba076a1c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:32.272324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:32.281967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:32.372845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957cfa4-eaa0-49c5-92ae-466e47274c4d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:32.404998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c61a7-d38c-4008-bde1-00ed1d07c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:32.405611 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c61a7-d38c-4008-bde1-00ed1d07c73c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:32.405895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c61a7-d38c-4008-bde1-00ed1d07c73c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:32.406172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c61a7-d38c-4008-bde1-00ed1d07c73c None admin] PATH_INFO: `/v3/projects/2b7fb182482041b49b0d3602bc1365a5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:32.407303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c61a7-d38c-4008-bde1-00ed1d07c73c None admin] RBAC: Authorizing `identity:get_project(project_id=2b7fb182482041b49b0d3602bc1365a5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:32.408724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c61a7-d38c-4008-bde1-00ed1d07c73c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:32.410354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 602/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:32 2022] GET /identity/v3/projects/2b7fb182482041b49b0d3602bc1365a5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:32.416905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b5f59-4080-48d6-bcd8-36fec2cf6928 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:32.499637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:32.517906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b5f59-4080-48d6-bcd8-36fec2cf6928 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:32.554947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55472f3b-910e-4937-99b0-18b418219908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:32.555610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55472f3b-910e-4937-99b0-18b418219908 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:32.555891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55472f3b-910e-4937-99b0-18b418219908 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:32.556166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55472f3b-910e-4937-99b0-18b418219908 None admin] PATH_INFO: `/v3/projects/2b7fb182482041b49b0d3602bc1365a5/users/0bb59785b76b442fba33bb10ba076a1c/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:32.558862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55472f3b-910e-4937-99b0-18b418219908 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b7fb182482041b49b0d3602bc1365a5, user_id=0bb59785b76b442fba33bb10ba076a1c, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:32.560292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55472f3b-910e-4937-99b0-18b418219908 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:32.575823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 590/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:04:32 2022] PUT /identity/v3/projects/2b7fb182482041b49b0d3602bc1365a5/users/0bb59785b76b442fba33bb10ba076a1c/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:04:34.500823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa44a5e-ae6e-4288-80aa-0fd16f88498a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:34.501360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa44a5e-ae6e-4288-80aa-0fd16f88498a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:34.501360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa44a5e-ae6e-4288-80aa-0fd16f88498a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:34.502773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 603/1193] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:34.508901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c618-ac24-4c23-a349-68f070eceeb5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:34.509425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c618-ac24-4c23-a349-68f070eceeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:34.509531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c618-ac24-4c23-a349-68f070eceeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:34.531242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e840c618-ac24-4c23-a349-68f070eceeb5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:34.532596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e840c618-ac24-4c23-a349-68f070eceeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:34.607643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 591/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:34.884463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa44a5e-ae6e-4288-80aa-0fd16f88498a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:34.978126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:35.004741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa44a5e-ae6e-4288-80aa-0fd16f88498a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:35.038721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78d247-68d8-4318-b1c1-8f48614e00ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:35.039355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78d247-68d8-4318-b1c1-8f48614e00ee None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:35.039639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78d247-68d8-4318-b1c1-8f48614e00ee None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:35.039919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78d247-68d8-4318-b1c1-8f48614e00ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:35.051306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78d247-68d8-4318-b1c1-8f48614e00ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0d78d247-68d8-4318-b1c1-8f48614e00ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:35.056074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:35.057032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:35.058172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:04:35.059085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 604/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:35.063459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c618-ac24-4c23-a349-68f070eceeb5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:35.161477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:35.201819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c618-ac24-4c23-a349-68f070eceeb5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:35.244327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:35.245174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:35.245560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:35.245933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:35.246843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:35.247270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:35.248925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:35.261729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 592/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:35.267655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78d247-68d8-4318-b1c1-8f48614e00ee None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:35.365818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78d247-68d8-4318-b1c1-8f48614e00ee None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:35.399697 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccf5d-801a-40f0-a087-e865071bfc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:35.400381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccf5d-801a-40f0-a087-e865071bfc86 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:35.400686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccf5d-801a-40f0-a087-e865071bfc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:35.401601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccf5d-801a-40f0-a087-e865071bfc86 None admin] PATH_INFO: `/v3/users/0bb59785b76b442fba33bb10ba076a1c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:35.402815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bccf5d-801a-40f0-a087-e865071bfc86 None admin] RBAC: Authorizing `identity:get_user(user_id=0bb59785b76b442fba33bb10ba076a1c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:35.404450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bccf5d-801a-40f0-a087-e865071bfc86 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:35.406084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 605/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:35 2022] GET /identity/v3/users/0bb59785b76b442fba33bb10ba076a1c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:35.412999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:35.547154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38843140-19ec-42c3-b2e9-de8dbd8af78c None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:35.602054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a861d-c3ec-4102-8dec-b03d006ab8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:35.603129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a861d-c3ec-4102-8dec-b03d006ab8bf None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:35.603631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a861d-c3ec-4102-8dec-b03d006ab8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:35.604131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a861d-c3ec-4102-8dec-b03d006ab8bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:35.608205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:35.676120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a861d-c3ec-4102-8dec-b03d006ab8bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:35.677547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a861d-c3ec-4102-8dec-b03d006ab8bf None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:35.780172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 593/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:04:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 08:04:35.786194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccf5d-801a-40f0-a087-e865071bfc86 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:35.789471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:35.890486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccf5d-801a-40f0-a087-e865071bfc86 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:35.924345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b55e2-91a7-4dfc-9d14-21f426989ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:35.924977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b55e2-91a7-4dfc-9d14-21f426989ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:35.925265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b55e2-91a7-4dfc-9d14-21f426989ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:35.925548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b55e2-91a7-4dfc-9d14-21f426989ce6 None admin] PATH_INFO: `/v3/projects/2b7fb182482041b49b0d3602bc1365a5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:35.926751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b55e2-91a7-4dfc-9d14-21f426989ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=2b7fb182482041b49b0d3602bc1365a5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:35.928132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b55e2-91a7-4dfc-9d14-21f426989ce6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:35.929769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 606/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:35 2022] GET /identity/v3/projects/2b7fb182482041b49b0d3602bc1365a5 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:35.939479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a861d-c3ec-4102-8dec-b03d006ab8bf None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:35.979061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:36.046531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a861d-c3ec-4102-8dec-b03d006ab8bf None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:36.080126 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ac8a4-ff5e-4f64-b9bd-bea2f930690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:36.080760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac8a4-ff5e-4f64-b9bd-bea2f930690f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:36.081049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac8a4-ff5e-4f64-b9bd-bea2f930690f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:36.081323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac8a4-ff5e-4f64-b9bd-bea2f930690f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:36.082042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ac8a4-ff5e-4f64-b9bd-bea2f930690f None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=2b7fb182482041b49b0d3602bc1365a5, user.id=0bb59785b76b442fba33bb10ba076a1c) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:36.082381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ac8a4-ff5e-4f64-b9bd-bea2f930690f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:36.083800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ac8a4-ff5e-4f64-b9bd-bea2f930690f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:36.089737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 594/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:04:35 2022] GET /identity/v3/role_assignments?user.id=0bb59785b76b442fba33bb10ba076a1c&scope.project.id=2b7fb182482041b49b0d3602bc1365a5&role.id=b76f0bbd02794923b10af161becac1c6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:45.920106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=65 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:46.086913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=51 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:34.162948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a6a9-1ec3-4be0-8877-f77177626b9d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:34.163838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a6a9-1ec3-4be0-8877-f77177626b9d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:34.163838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a6a9-1ec3-4be0-8877-f77177626b9d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:34.165888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 607/1201] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:34.172213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657ca90-6f4f-4508-a2ef-5aa669c7e6a4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:34.173221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657ca90-6f4f-4508-a2ef-5aa669c7e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:34.173542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657ca90-6f4f-4508-a2ef-5aa669c7e6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:34.199247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d657ca90-6f4f-4508-a2ef-5aa669c7e6a4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:34.200356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d657ca90-6f4f-4508-a2ef-5aa669c7e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:34.305608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 595/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:34.604746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15a6a9-1ec3-4be0-8877-f77177626b9d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:34.804211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15a6a9-1ec3-4be0-8877-f77177626b9d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:34.872956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:34.873947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:34.874423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:34.874807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:34.890531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:34.892895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:34.922113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:34.923280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:34.929860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:34.929860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:34.929860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:34.929860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 608/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:34.932074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657ca90-6f4f-4508-a2ef-5aa669c7e6a4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:35.078961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657ca90-6f4f-4508-a2ef-5aa669c7e6a4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:35.123295 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:35.130053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fa9e1-fba0-4958-ae6a-88f8c13f0d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:35.130737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fa9e1-fba0-4958-ae6a-88f8c13f0d3b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:35.130980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fa9e1-fba0-4958-ae6a-88f8c13f0d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:35.131251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fa9e1-fba0-4958-ae6a-88f8c13f0d3b None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:35.131915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fa9e1-fba0-4958-ae6a-88f8c13f0d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:35.132237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fa9e1-fba0-4958-ae6a-88f8c13f0d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:35.134143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fa9e1-fba0-4958-ae6a-88f8c13f0d3b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:35.156995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 596/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:35.164480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:35.250314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:35.340502 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07b88c-c2a0-499c-8e6b-c25a920b300c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:35.410280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd57b5-eb63-4fb6-b1fb-d73d410a9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:35.410984 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd57b5-eb63-4fb6-b1fb-d73d410a9c67 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:35.411279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd57b5-eb63-4fb6-b1fb-d73d410a9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:35.411557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd57b5-eb63-4fb6-b1fb-d73d410a9c67 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:35.412268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd57b5-eb63-4fb6-b1fb-d73d410a9c67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:35.413746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd57b5-eb63-4fb6-b1fb-d73d410a9c67 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:35.454518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 609/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 08:05:35 2022] POST /identity/v3/users => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:05:37.679900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b237-10dc-47e0-acf9-4ac4e16a2600 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:37.681161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b237-10dc-47e0-acf9-4ac4e16a2600 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:37.681161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b237-10dc-47e0-acf9-4ac4e16a2600 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:37.682781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 597/1206] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:37.689525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503576c1-0f26-49cc-afc8-f9f556d9848a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:37.690071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503576c1-0f26-49cc-afc8-f9f556d9848a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:37.690431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503576c1-0f26-49cc-afc8-f9f556d9848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:37.731168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-503576c1-0f26-49cc-afc8-f9f556d9848a None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:37.732499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-503576c1-0f26-49cc-afc8-f9f556d9848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:37.832369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 610/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:38.131349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3b237-10dc-47e0-acf9-4ac4e16a2600 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:38.271913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3b237-10dc-47e0-acf9-4ac4e16a2600 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:38.315230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ccf6f-9764-4125-987c-e88bf003e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:38.315879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ccf6f-9764-4125-987c-e88bf003e5ae None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:38.316167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ccf6f-9764-4125-987c-e88bf003e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:38.316449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ccf6f-9764-4125-987c-e88bf003e5ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:38.339121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ccf6f-9764-4125-987c-e88bf003e5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-072ccf6f-9764-4125-987c-e88bf003e5ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:38.344060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:38.345048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:38.345958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:38.347779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 598/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:38.354902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503576c1-0f26-49cc-afc8-f9f556d9848a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:38.416081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:38.520440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503576c1-0f26-49cc-afc8-f9f556d9848a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:38.588562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:38.589542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:38.589915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:38.590418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:38.591482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:38.591971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:38.594523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:38.609627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 611/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:38.618295 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ccf6f-9764-4125-987c-e88bf003e5ae None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:38.703799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:38.779465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ccf6f-9764-4125-987c-e88bf003e5ae None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:38.827951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:38.828638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:38.828924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:38.829200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:38.856487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:38.858688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:38.876221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:38.878723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:38.882366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:38.882366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:38.882366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:38.882366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 599/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:38.884692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:39.030249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:39.035238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145787-fd73-4e15-90f6-26484fe209bb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:39.093737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:39.094732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:39.095145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:39.095591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:39.096696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:39.097137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:39.099116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:39.119155 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 612/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:39.126927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:39.291148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85babfd-fc66-4222-bf46-91935543199d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:39.293194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:39.350179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:39.351297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:39.351584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:39.351863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:39.363731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:39.365192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:39.382317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:39.383604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:39.385440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:39.388245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 600/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:39.397377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:39.580108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6d0c-c523-499c-ac66-6e4dbe275ff9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:39.639432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:39.640070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:39.640402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:39.640688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:39.641499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:39.641809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:39.643231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:39.665490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 613/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:39.676366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:39.852308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75d2de-dbf7-45e5-9f36-2fc6c7c20283 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:39.899796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23312401-fe7f-40cc-8152-5f9bd7ac7449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:39.900939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312401-fe7f-40cc-8152-5f9bd7ac7449 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:39.901425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312401-fe7f-40cc-8152-5f9bd7ac7449 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:39.902762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312401-fe7f-40cc-8152-5f9bd7ac7449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:39.952293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:39.996727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23312401-fe7f-40cc-8152-5f9bd7ac7449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:39.998319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23312401-fe7f-40cc-8152-5f9bd7ac7449 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.159332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 601/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:05:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:05:40.167712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:40.193722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:40.318846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c1d98-333a-449f-8493-c6519adf3858 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:40.365964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:40.366926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:40.367344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:40.367633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:40.384451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:40.386874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:40.405489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:40.406730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:40.407882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:40.407882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:40.407882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:40.414382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 614/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:40.414586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23312401-fe7f-40cc-8152-5f9bd7ac7449 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:40.504265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:40.575864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23312401-fe7f-40cc-8152-5f9bd7ac7449 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:40.631619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:40.632621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:40.633273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:40.634666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:40.636219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:40.636821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:40.639637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.659626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 602/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:40.666251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:40.784306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:40.824302 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6038c-7dcb-4bc2-b757-334db84f0c4f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:40.862570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:40.863325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:40.863652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:40.864002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:40.877147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:40.878948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:40.891957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:40.893270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:40.894411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 615/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:40.904096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:41.044956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4de67-5a5c-4764-a3f6-f9a8c7704519 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:41.072674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:41.087793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde03ebb-de63-4a8e-aa22-271fb59877bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:41.088635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde03ebb-de63-4a8e-aa22-271fb59877bc None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:41.088988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde03ebb-de63-4a8e-aa22-271fb59877bc None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:41.089323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde03ebb-de63-4a8e-aa22-271fb59877bc None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:41.090193 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde03ebb-de63-4a8e-aa22-271fb59877bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:41.090586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde03ebb-de63-4a8e-aa22-271fb59877bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:41.092265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde03ebb-de63-4a8e-aa22-271fb59877bc None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:41.114139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 603/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:41.118826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:41.262424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a41db-2cfd-4681-8502-77b56294cfa0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:41.301690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:41.310876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f531-3906-40c0-ac53-78bb9236af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:41.311787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f531-3906-40c0-ac53-78bb9236af52 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:41.312304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f531-3906-40c0-ac53-78bb9236af52 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:41.312775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f531-3906-40c0-ac53-78bb9236af52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:41.313791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f531-3906-40c0-ac53-78bb9236af52 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=61c0e264e31845b9811944ba6cf976be) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:41.314367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f531-3906-40c0-ac53-78bb9236af52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:41.316230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f531-3906-40c0-ac53-78bb9236af52 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:41.334295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 616/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:05:41 2022] GET /identity/v3/role_assignments?user.id=61c0e264e31845b9811944ba6cf976be&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:43.388754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8782-7370-470b-b487-dcacf6864437 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:43.389321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8782-7370-470b-b487-dcacf6864437 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:43.389429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8782-7370-470b-b487-dcacf6864437 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:43.391282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 604/1220] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:43.397528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28c838-5f68-45a4-810a-2cc9ac311948 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:43.398162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28c838-5f68-45a4-810a-2cc9ac311948 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:43.398162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28c838-5f68-45a4-810a-2cc9ac311948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:43.417770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2c28c838-5f68-45a4-810a-2cc9ac311948 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:43.419023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2c28c838-5f68-45a4-810a-2cc9ac311948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:43.500931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 617/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:43.815367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8782-7370-470b-b487-dcacf6864437 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:43.944283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8782-7370-470b-b487-dcacf6864437 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:43.988268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c2d3a-f7fe-4eda-819c-f7daefdb6e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:43.989054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c2d3a-f7fe-4eda-819c-f7daefdb6e9d None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:43.989314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c2d3a-f7fe-4eda-819c-f7daefdb6e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:43.989586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c2d3a-f7fe-4eda-819c-f7daefdb6e9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.003707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c2d3a-f7fe-4eda-819c-f7daefdb6e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-501c2d3a-f7fe-4eda-819c-f7daefdb6e9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:44.009050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:44.010597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:44.011860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 605/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:05:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:44.016332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28c838-5f68-45a4-810a-2cc9ac311948 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.131863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28c838-5f68-45a4-810a-2cc9ac311948 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.160766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.173942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.174729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.175071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.175392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.176173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:44.176508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.178117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.186936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 618/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:44.192781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c2d3a-f7fe-4eda-819c-f7daefdb6e9d None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.247228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.332111 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c2d3a-f7fe-4eda-819c-f7daefdb6e9d None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.389895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.390881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.391338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.391987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.406813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.408472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:44.426031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:44.427689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:44.429050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:44.429050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:44.429050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:44.429050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 606/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:44.436358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.547481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73badfca-707f-4cd2-9514-c6f240cfaa4f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.584076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.584763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.585062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.585346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.586070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:44.586983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.588619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.606553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 619/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:44.610212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.725345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.733468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875f20-f210-4e38-a3f1-cb0d170219ff None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.771829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.772468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.772753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.773087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.782603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.784076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:44.797330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:44.799096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:44.800302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 607/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:44.804479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.860304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.926293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abef87-f156-4a6a-b12e-06204a922360 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.960509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.961117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.961401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.961835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.962773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:44.963082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.964523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.983629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 620/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:44.989537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.112048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28125386-4a06-497a-936c-0b6a3fe98de8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.150972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.151783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.152166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.152541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.166608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.168768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:45.188780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:45.189895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:45.190847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:45.190847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:45.190847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:45.190847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 608/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:45.197806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.320197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f139e64-a39e-4373-9ae9-45cdfe6995ae None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.323049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:45.362450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.363235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.363569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.363841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.364677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:45.365067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.367255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.381453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 621/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:45.387727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.397777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:45.515686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071b9f-75d2-48dc-96b0-26b3fde78371 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.555092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.555978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.556307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.556638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.564920 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.566626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:45.579887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:45.581647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:45.583925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 609/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:45.589121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.736015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9fdd-bedc-47d5-b430-68044cdd9ba0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.792176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd687a8-37f3-4069-a0d5-9457b4201ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.793284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd687a8-37f3-4069-a0d5-9457b4201ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.793628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd687a8-37f3-4069-a0d5-9457b4201ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.794180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd687a8-37f3-4069-a0d5-9457b4201ec2 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.795560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd687a8-37f3-4069-a0d5-9457b4201ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:45.796169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd687a8-37f3-4069-a0d5-9457b4201ec2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.799194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd687a8-37f3-4069-a0d5-9457b4201ec2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.818660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 622/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:45.825465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.906763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:45.951425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d8bd5-9754-4aff-998f-9fc680074888 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.993368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc30a9f-1964-4848-9ff5-925590535695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.994134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc30a9f-1964-4848-9ff5-925590535695 None admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.994466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc30a9f-1964-4848-9ff5-925590535695 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.994744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc30a9f-1964-4848-9ff5-925590535695 None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/61c0e264e31845b9811944ba6cf976be/roles/e9ad041f2bf540a9a37d7672449d853f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:46.012733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc30a9f-1964-4848-9ff5-925590535695 None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=61c0e264e31845b9811944ba6cf976be, role_id=e9ad041f2bf540a9a37d7672449d853f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:46.014241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc30a9f-1964-4848-9ff5-925590535695 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:46.030434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 610/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:05:45 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/61c0e264e31845b9811944ba6cf976be/roles/e9ad041f2bf540a9a37d7672449d853f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:05:48.191789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e5a9-e4a6-4a3d-838f-768aa965ca18 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:48.192364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e5a9-e4a6-4a3d-838f-768aa965ca18 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:48.192364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e5a9-e4a6-4a3d-838f-768aa965ca18 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:48.193725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 623/1233] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:48.200528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3c0ff-32d4-408e-a94f-ad4bce128524 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:48.201048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3c0ff-32d4-408e-a94f-ad4bce128524 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:48.201168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3c0ff-32d4-408e-a94f-ad4bce128524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:48.221329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-33f3c0ff-32d4-408e-a94f-ad4bce128524 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:48.223080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-33f3c0ff-32d4-408e-a94f-ad4bce128524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:48.303329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 611/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:48.591179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570e5a9-e4a6-4a3d-838f-768aa965ca18 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:48.622370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:48.708410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570e5a9-e4a6-4a3d-838f-768aa965ca18 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:48.754610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffd44-c4fb-4438-b6eb-050cd890456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:48.755263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffd44-c4fb-4438-b6eb-050cd890456c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:48.755631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffd44-c4fb-4438-b6eb-050cd890456c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:48.756096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffd44-c4fb-4438-b6eb-050cd890456c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:48.770397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ffd44-c4fb-4438-b6eb-050cd890456c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-423ffd44-c4fb-4438-b6eb-050cd890456c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:48.775730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:48.777863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:48.779462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 624/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 08:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:48.784074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3c0ff-32d4-408e-a94f-ad4bce128524 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:48.869031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:48.927726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3c0ff-32d4-408e-a94f-ad4bce128524 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:48.970183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:48.970834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:48.971134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:48.971390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:48.972068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] RBAC: Adding query filter params (name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:48.972367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:48.973738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:48.983104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 612/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 08:05:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:48.989137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffd44-c4fb-4438-b6eb-050cd890456c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.086703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:49.106135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffd44-c4fb-4438-b6eb-050cd890456c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.147313 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.148123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.148492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.148912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:49.164403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:49.166791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:49.187349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:49.189534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:49.191026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:49.191026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:49.191026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:49.191026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 625/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:49.195489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.323572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c8875-c0df-47ae-9ca4-e939e2f8a772 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.332884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:49.362877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.363488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.363787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.364063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:49.364926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:49.365260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:49.367196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:49.388581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 613/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:49.389847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.525901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda62277-2f21-43da-a642-df7b2c314a00 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.568020 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.568864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.569308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.569619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:49.574166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:49.581179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:49.582927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:49.595451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:49.597660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:49.599756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:49.602807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 626/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:49.603597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.722738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd6165-631f-4ef9-8fac-d3570e1caa61 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.765616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.767718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.768213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.768349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:49.769157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:49.769464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:49.771205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:49.792404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 614/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:49.798707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.930953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de201e45-eaf6-414a-8097-572aed1af62a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.976436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb0fc-5ebd-45fb-8391-9025871aec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.976951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb0fc-5ebd-45fb-8391-9025871aec28 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.977305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb0fc-5ebd-45fb-8391-9025871aec28 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.977582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb0fc-5ebd-45fb-8391-9025871aec28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.048876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:50.056652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cb0fc-5ebd-45fb-8391-9025871aec28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.058245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cb0fc-5ebd-45fb-8391-9025871aec28 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.181930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 627/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:05:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 08:05:50.183617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:50.218879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:50.303265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab04d-c99c-42a2-9c5e-badd8a53bb45 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:50.343284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:50.343981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:50.344320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:50.344560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.356837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.358452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:50.374063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:50.375281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:50.376320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:50.376320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:50.376320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:50.376320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 615/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:50.382291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb0fc-5ebd-45fb-8391-9025871aec28 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:50.498738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:50.506589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb0fc-5ebd-45fb-8391-9025871aec28 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:50.544217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:50.544848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:50.545123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:50.545396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.546064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:50.546389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.547796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.562371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 628/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:50.566588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:50.656501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:50.684557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf00f7a-c1f6-42a2-b79f-6a6a7bfb10de None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:50.727381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:50.728071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:50.728356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:50.728631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.737611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.739133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:50.752237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:50.753458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:50.754643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 616/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:50.761936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:50.893636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81b8b4-af11-4fcd-8a98-e0ccff94ec7b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:50.929787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7132b62-4dbc-4eb2-aefd-70cfb42c96b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:50.931051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132b62-4dbc-4eb2-aefd-70cfb42c96b0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:50.931330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132b62-4dbc-4eb2-aefd-70cfb42c96b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:50.931601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132b62-4dbc-4eb2-aefd-70cfb42c96b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.932292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7132b62-4dbc-4eb2-aefd-70cfb42c96b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:50.932618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7132b62-4dbc-4eb2-aefd-70cfb42c96b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.934135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7132b62-4dbc-4eb2-aefd-70cfb42c96b0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.946920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 629/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:50.953101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:51.065587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615a5e-67fa-40fa-a460-833a2c206bfd None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:51.100641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89853a3a-fa01-47ff-8130-0d0852e56c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:51.101244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853a3a-fa01-47ff-8130-0d0852e56c09 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:51.101521 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853a3a-fa01-47ff-8130-0d0852e56c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:51.101788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89853a3a-fa01-47ff-8130-0d0852e56c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:51.103216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89853a3a-fa01-47ff-8130-0d0852e56c09 None admin] RBAC: Adding query filter params (role.id=e9ad041f2bf540a9a37d7672449d853f, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=61c0e264e31845b9811944ba6cf976be) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:51.103541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89853a3a-fa01-47ff-8130-0d0852e56c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:51.104959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89853a3a-fa01-47ff-8130-0d0852e56c09 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:51.126338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 617/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:05:50 2022] GET /identity/v3/role_assignments?user.id=61c0e264e31845b9811944ba6cf976be&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=e9ad041f2bf540a9a37d7672449d853f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:53.177142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2320d39-f017-483b-9f97-dabb10e1ba75 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:53.178003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2320d39-f017-483b-9f97-dabb10e1ba75 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:53.178003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2320d39-f017-483b-9f97-dabb10e1ba75 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:53.179151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 630/1247] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:53.184799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864e42-6f3a-4932-9b3c-0fdd83eb6a41 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:53.185275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864e42-6f3a-4932-9b3c-0fdd83eb6a41 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:53.185383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864e42-6f3a-4932-9b3c-0fdd83eb6a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:53.191893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:53.207290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-81864e42-6f3a-4932-9b3c-0fdd83eb6a41 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:53.208524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-81864e42-6f3a-4932-9b3c-0fdd83eb6a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:53.287566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 618/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:53.565879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2320d39-f017-483b-9f97-dabb10e1ba75 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:53.585500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:53.704172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2320d39-f017-483b-9f97-dabb10e1ba75 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:53.757950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5632f-c22c-4092-bbfd-0dc7af8d3fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:53.759087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5632f-c22c-4092-bbfd-0dc7af8d3fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:53.759367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5632f-c22c-4092-bbfd-0dc7af8d3fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:53.759719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5632f-c22c-4092-bbfd-0dc7af8d3fc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:53.772800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5632f-c22c-4092-bbfd-0dc7af8d3fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-03f5632f-c22c-4092-bbfd-0dc7af8d3fc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:53.778952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:53.781044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:53.782733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 631/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:05:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:53.786669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81864e42-6f3a-4932-9b3c-0fdd83eb6a41 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:53.904830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81864e42-6f3a-4932-9b3c-0fdd83eb6a41 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:53.937765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:53.943590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:53.944224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:53.944687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:53.945176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:53.945881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:53.946312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:53.947655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:53.956624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 619/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:05:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:53.962769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5632f-c22c-4092-bbfd-0dc7af8d3fc7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:54.057711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:54.084599 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5632f-c22c-4092-bbfd-0dc7af8d3fc7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:54.128047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:54.129052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:54.129414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:54.129710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:54.143632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:54.145617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:54.163645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:54.165694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:54.166709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:54.166709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:54.166709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:54.166709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 632/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:54.171653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:54.292168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bd1d9-b935-4f2d-97de-bb318c4640e3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:54.328576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:54.329125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:54.329402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:54.329678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:54.330474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:54.330780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:54.332285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:54.345525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 620/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:54.351560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:54.477819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac58f9-2b77-47ba-b4e8-c3ed39571956 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:54.506806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:54.516021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:54.517130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:54.517421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:54.517698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:54.530149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:54.531983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:54.545256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:54.546548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:54.547728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 633/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:54.553238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:54.620349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:54.670870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a713a80-f872-4f49-901b-7feb8ac3fdb0 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:54.712919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:54.713567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:54.713851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:54.714127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:54.714958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:54.715259 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:54.720418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:54.749399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 621/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:54.750974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:54.873704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bae5b-49c0-4bc8-8779-0b622a70f8b0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:54.910719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5ca7-6ede-4201-8d8f-4c43aa2a5a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:54.911363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5ca7-6ede-4201-8d8f-4c43aa2a5a46 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:54.911655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5ca7-6ede-4201-8d8f-4c43aa2a5a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:54.911918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c5ca7-6ede-4201-8d8f-4c43aa2a5a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:54.979381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:54.996187 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5ca7-6ede-4201-8d8f-4c43aa2a5a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:54.997853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c5ca7-6ede-4201-8d8f-4c43aa2a5a46 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:55.111144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 634/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:05:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:05:55.118236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:55.235605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cffab3-64bf-4857-9537-3961496f995f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:55.251885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:55.277348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:55.277991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:55.278357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:55.278630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:55.290159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:55.291843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:55.308000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:55.309669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:55.310778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:55.310778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:55.310778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:55.314488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 622/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:55.315568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5ca7-6ede-4201-8d8f-4c43aa2a5a46 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:55.416883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:55.431018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c5ca7-6ede-4201-8d8f-4c43aa2a5a46 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:55.474818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:55.475434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:55.475700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:55.475972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:55.476660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:55.477135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:55.478641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:55.496553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 635/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:55.497575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:55.611627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54a93-f19d-4b10-bf87-f59233123da2 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:55.650235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:55.650893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:55.651176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:55.651449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:55.658648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:55.660112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:55.673266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:55.674452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:05:55.675383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 623/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:55.681826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:55.797644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b76d0-48a6-422c-8fef-2d64447e17a6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:55.843344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2dd27-7112-4393-a29d-bf87667e1c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:55.844059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2dd27-7112-4393-a29d-bf87667e1c60 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:55.844309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2dd27-7112-4393-a29d-bf87667e1c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:55.844585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2dd27-7112-4393-a29d-bf87667e1c60 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:55.845283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2dd27-7112-4393-a29d-bf87667e1c60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:55.845600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2dd27-7112-4393-a29d-bf87667e1c60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:55.847057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2dd27-7112-4393-a29d-bf87667e1c60 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:55.859953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 636/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:55.866186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:55.898486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:55.984579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14d1af-d513-4f2e-b03d-f0bcaab3f89e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:56.027096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76d7e-0247-47d0-b35d-547dd9afa243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:56.027805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76d7e-0247-47d0-b35d-547dd9afa243 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:56.028157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76d7e-0247-47d0-b35d-547dd9afa243 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:56.028499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76d7e-0247-47d0-b35d-547dd9afa243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:56.029296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d76d7e-0247-47d0-b35d-547dd9afa243 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=61c0e264e31845b9811944ba6cf976be) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:56.029681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d76d7e-0247-47d0-b35d-547dd9afa243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:56.031507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d76d7e-0247-47d0-b35d-547dd9afa243 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:56.050398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 624/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:05:55 2022] GET /identity/v3/role_assignments?user.id=61c0e264e31845b9811944ba6cf976be&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=b76f0bbd02794923b10af161becac1c6 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:58.015701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8becf8-2877-4d08-b1b4-c404723bb83e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.016229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8becf8-2877-4d08-b1b4-c404723bb83e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.016361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8becf8-2877-4d08-b1b4-c404723bb83e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.017618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 637/1261] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:58.022770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998b94-684d-4a92-a393-8e91371c03b2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.023205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998b94-684d-4a92-a393-8e91371c03b2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.023328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998b94-684d-4a92-a393-8e91371c03b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.041460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f8998b94-684d-4a92-a393-8e91371c03b2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:58.042678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f8998b94-684d-4a92-a393-8e91371c03b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:58.108275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 625/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:58.374957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8becf8-2877-4d08-b1b4-c404723bb83e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:58.386218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:58.478153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8becf8-2877-4d08-b1b4-c404723bb83e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:58.516245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e083d18-8e0e-491e-8b90-4bd6d0756774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:58.516873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e083d18-8e0e-491e-8b90-4bd6d0756774 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.517156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e083d18-8e0e-491e-8b90-4bd6d0756774 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.517429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e083d18-8e0e-491e-8b90-4bd6d0756774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.528953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e083d18-8e0e-491e-8b90-4bd6d0756774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6e083d18-8e0e-491e-8b90-4bd6d0756774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:58.533731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:58.534958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:58.536215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 638/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:58.541499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998b94-684d-4a92-a393-8e91371c03b2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:58.561807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:58.644129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998b94-684d-4a92-a393-8e91371c03b2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:58.678401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:58.679004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.679284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.679556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.680273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:58.680576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:58.681936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:58.690062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 626/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:58.696017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e083d18-8e0e-491e-8b90-4bd6d0756774 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:58.771769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:58.821687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e083d18-8e0e-491e-8b90-4bd6d0756774 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:58.860103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:58.860736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.861018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.861295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.871753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:58.873204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:58.887579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:58.888685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:58.889775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:58.889775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:58.889775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:58.889775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 639/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:58.894758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:58.976664 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:59.003336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8593183-27f6-44ef-81ad-9bf14f6fb0e8 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:59.036568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:59.037243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:59.037430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:59.037700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:59.038358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:59.038660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:59.040037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:59.051471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 627/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:59.057223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:59.157822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df0233-a4ed-4644-9c0e-81cc89910d1d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:59.177051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:59.192274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:59.192901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:59.193178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:59.193450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:59.201579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:59.203050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:59.214850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:59.216000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:59.217076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 640/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:59.221860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:59.328427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc79c6e-bc6e-4669-ac1d-8d2fca51e7ab None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:59.362844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:59.363457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:59.363734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:59.364001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:59.364726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:59.365030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:59.366748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:59.376715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:59.386520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 628/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:59.392420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:59.493103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d95d-ea4d-42ea-8d41-575e9b203d6c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:59.525906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:59.526551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:59.526827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:59.527095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:59.537276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:59.538749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:59.552918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:59.554047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:59.555921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:59.555921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:59.555921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:59.555921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 641/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:59.560428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:59.658527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b765e2f-77f5-4a52-b022-a51362c86226 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:59.694215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:59.694858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:59.695134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:59.695423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:59.696220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:59.696523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:59.697872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:59.708938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 629/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:59.714646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:59.746989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:59.817439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192705c-425c-400a-8cca-3c5a24d89043 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:59.849538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:59.850156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:59.850472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:59.850746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:59.857939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:59.859393 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:59.871503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:59.872568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:05:59.873719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 642/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:59.878520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:59.935586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:59.976554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6004-07df-44f3-b3ba-90fa4e9ed63b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:00.010778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43d0f4-5229-402c-b919-ca6689f1b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:00.011316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43d0f4-5229-402c-b919-ca6689f1b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:00.011594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43d0f4-5229-402c-b919-ca6689f1b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:00.011868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43d0f4-5229-402c-b919-ca6689f1b2c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:00.012549 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43d0f4-5229-402c-b919-ca6689f1b2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:00.012853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43d0f4-5229-402c-b919-ca6689f1b2c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:00.014302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43d0f4-5229-402c-b919-ca6689f1b2c0 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:00.025845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 630/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:00.035171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:00.130813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:00.140841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa51f-62bc-434d-a6d7-31819e6ad29e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:00.174285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ede63-7778-4e6c-8683-729dbfd2d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:00.174944 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ede63-7778-4e6c-8683-729dbfd2d25a None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:00.175222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ede63-7778-4e6c-8683-729dbfd2d25a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:00.175494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ede63-7778-4e6c-8683-729dbfd2d25a None admin] PATH_INFO: `/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/61c0e264e31845b9811944ba6cf976be/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:00.177383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ede63-7778-4e6c-8683-729dbfd2d25a None admin] RBAC: Authorizing `identity:create_grant(project_id=043bbb7e8876497ebf1a84cc504aaff1, user_id=61c0e264e31845b9811944ba6cf976be, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:00.178830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ede63-7778-4e6c-8683-729dbfd2d25a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:00.191173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 643/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 08:06:00 2022] PUT /identity/v3/projects/043bbb7e8876497ebf1a84cc504aaff1/users/61c0e264e31845b9811944ba6cf976be/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:06:02.096145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ace3-1738-4186-be79-e6d7d5ca2b63 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:02.096730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ace3-1738-4186-be79-e6d7d5ca2b63 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:02.096730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ace3-1738-4186-be79-e6d7d5ca2b63 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:02.098045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 631/1274] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:06:02.104573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513df67c-5bd5-44cc-9d4a-f415c993ae19 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:02.105095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513df67c-5bd5-44cc-9d4a-f415c993ae19 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:02.105198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513df67c-5bd5-44cc-9d4a-f415c993ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:02.125168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-513df67c-5bd5-44cc-9d4a-f415c993ae19 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:06:02.126430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-513df67c-5bd5-44cc-9d4a-f415c993ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:06:02.199428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 644/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:06:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:06:02.474139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301ace3-1738-4186-be79-e6d7d5ca2b63 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:02.579852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301ace3-1738-4186-be79-e6d7d5ca2b63 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:02.597830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:02.615514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c1370-e80c-4922-aea9-82592760b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:02.616404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c1370-e80c-4922-aea9-82592760b39e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:02.616695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c1370-e80c-4922-aea9-82592760b39e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:02.616970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c1370-e80c-4922-aea9-82592760b39e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:02.627756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c1370-e80c-4922-aea9-82592760b39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-de5c1370-e80c-4922-aea9-82592760b39e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:06:02.632493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:02.634348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:02.635617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 632/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 08:06:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:06:02.640376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513df67c-5bd5-44cc-9d4a-f415c993ae19 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:02.719972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:02.740678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513df67c-5bd5-44cc-9d4a-f415c993ae19 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:02.779623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:02.780481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:02.780805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:02.781168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:02.782065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:02.782490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:02.784137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:02.797802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 645/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 08:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:02.804583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c1370-e80c-4922-aea9-82592760b39e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:02.922700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c1370-e80c-4922-aea9-82592760b39e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:02.956881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:02.957505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:02.957782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:02.958052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:02.969644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:02.971129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:06:02.986919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:02.988809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:06:02.990794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:06:02.990794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:06:02.990794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:02.990794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 633/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:06:02.996276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:03.103425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd671f39-006d-47ad-949b-66a85c319223 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:03.144740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:03.145411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:03.145629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:03.145906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:03.146675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:03.146986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:03.148376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:03.163140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 646/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:06:03.170050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:03.205314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:03.279979 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893af43-b3d8-4547-abdf-89cd8dd4e5e3 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:03.314177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:03.314837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:03.315115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:03.315386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:03.323238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:03.324748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:06:03.336890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:03.338715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:03.340807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 634/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:06:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:06:03.345610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:03.349978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:03.452036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c90e-0fb4-46dc-a805-f2bf9d339f17 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:03.488230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:03.488850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:03.489130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:03.489402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:03.490130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:03.490462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:03.492193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:03.513667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 647/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 08:06:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:03.519566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:03.613783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:03.624148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01217f-a74f-474d-b7ac-4e2b0043089e None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:03.660706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6694f-7586-4006-95a1-bff1f2edfc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:03.661321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6694f-7586-4006-95a1-bff1f2edfc18 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:03.661610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6694f-7586-4006-95a1-bff1f2edfc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:03.661876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6694f-7586-4006-95a1-bff1f2edfc18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:03.761881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6694f-7586-4006-95a1-bff1f2edfc18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:03.764636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6694f-7586-4006-95a1-bff1f2edfc18 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:03.869022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:03.880466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 635/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 08:06:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:06:03.887200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:03.953923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:03.994428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5f410-730e-4ada-af01-ff3dc2ca7155 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:04.030605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:04.031249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:04.031528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:04.031804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:04.043355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:04.044807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:06:04.060382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:04.061676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:06:04.062889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:06:04.062889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:06:04.062889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:06:04.062889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 648/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:06:04.068310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6694f-7586-4006-95a1-bff1f2edfc18 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:04.172975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6694f-7586-4006-95a1-bff1f2edfc18 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:04.208893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:04.209497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:04.209775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:04.210046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:04.210714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:04.211567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:04.212940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:04.224427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 636/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 08:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:04.230749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:04.332685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e920ea0-ce44-4f05-96cd-b453742f79d0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:04.347481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:04.368606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:04.369248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:04.369532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:04.369809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:04.376901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:04.378374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:06:04.390379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:04.392082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 01 08:06:04.393793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 649/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 08:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:06:04.397489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:04.449083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:04.500397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fbb7b-bf98-4679-a8eb-2f7dc3b4bd7b None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:04.534650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6bf7-b4f3-4f4e-a5e0-9765e264b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:04.535253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6bf7-b4f3-4f4e-a5e0-9765e264b60e None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:04.535530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6bf7-b4f3-4f4e-a5e0-9765e264b60e None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:04.535804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6bf7-b4f3-4f4e-a5e0-9765e264b60e None admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:04.536485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6bf7-b4f3-4f4e-a5e0-9765e264b60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:04.536784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6bf7-b4f3-4f4e-a5e0-9765e264b60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:04.538194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6bf7-b4f3-4f4e-a5e0-9765e264b60e None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:04.550715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 637/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 08:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:04.557628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:04.660230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d7a8-5358-4b17-94c7-8615adf5c803 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:04.693850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a82be7-47e9-4944-8f5a-798c85068804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:04.694485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82be7-47e9-4944-8f5a-798c85068804 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:04.694767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82be7-47e9-4944-8f5a-798c85068804 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:04.695043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82be7-47e9-4944-8f5a-798c85068804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:04.696468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a82be7-47e9-4944-8f5a-798c85068804 None admin] RBAC: Adding query filter params (role.id=b76f0bbd02794923b10af161becac1c6, scope.project.id=043bbb7e8876497ebf1a84cc504aaff1, user.id=61c0e264e31845b9811944ba6cf976be) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:04.696778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a82be7-47e9-4944-8f5a-798c85068804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:04.698200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a82be7-47e9-4944-8f5a-798c85068804 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:04.703991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 650/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 08:06:04 2022] GET /identity/v3/role_assignments?user.id=61c0e264e31845b9811944ba6cf976be&scope.project.id=043bbb7e8876497ebf1a84cc504aaff1&role.id=b76f0bbd02794923b10af161becac1c6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:06.710011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979586-39c7-48bc-be40-815ea2298a55 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:06.710582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979586-39c7-48bc-be40-815ea2298a55 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:06.710582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979586-39c7-48bc-be40-815ea2298a55 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:06.712070 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 638/1288] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:06:06.718457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01faf-2604-4ea5-95b0-1be9f47b4c31 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:06.719000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01faf-2604-4ea5-95b0-1be9f47b4c31 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:06.719319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa01faf-2604-4ea5-95b0-1be9f47b4c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:06.741894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8aa01faf-2604-4ea5-95b0-1be9f47b4c31 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:06:06.744033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8aa01faf-2604-4ea5-95b0-1be9f47b4c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:06:06.793214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:06.848382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 651/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:06:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:06:07.185970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979586-39c7-48bc-be40-815ea2298a55 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:07.307128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979586-39c7-48bc-be40-815ea2298a55 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:07.318688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:07.343125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:07.343755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:07.344033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:07.344302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:07.344878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:07.346225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:07.354738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:07.355954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:07.357116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 639/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:06:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:06:07.362335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa01faf-2604-4ea5-95b0-1be9f47b4c31 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:07.476311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa01faf-2604-4ea5-95b0-1be9f47b4c31 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:07.514648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba9d71-4387-4208-8b77-20bafc59de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:07.515368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9d71-4387-4208-8b77-20bafc59de88 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:07.515656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9d71-4387-4208-8b77-20bafc59de88 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:07.515928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9d71-4387-4208-8b77-20bafc59de88 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:07.516576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba9d71-4387-4208-8b77-20bafc59de88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:07.516887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba9d71-4387-4208-8b77-20bafc59de88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:07.518935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba9d71-4387-4208-8b77-20bafc59de88 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:07.525850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 652/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Sep 1 08:06:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:07.531966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:07.639657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47629d53-e97b-4ad4-a804-6a04134b343f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:07.675207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4901a-c5f2-4257-b7ec-e9fea5735e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:07.675861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4901a-c5f2-4257-b7ec-e9fea5735e73 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:07.676140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4901a-c5f2-4257-b7ec-e9fea5735e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:07.676444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4901a-c5f2-4257-b7ec-e9fea5735e73 None admin] PATH_INFO: `/v3/services` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:07.677115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4901a-c5f2-4257-b7ec-e9fea5735e73 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:07.677421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4901a-c5f2-4257-b7ec-e9fea5735e73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:07.678895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4901a-c5f2-4257-b7ec-e9fea5735e73 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:07.684884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 640/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Sep 1 08:06:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:09.712220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356b758-0585-410a-9c99-3cf1fd026284 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:09.712823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356b758-0585-410a-9c99-3cf1fd026284 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:09.712823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356b758-0585-410a-9c99-3cf1fd026284 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:09.714229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 653/1293] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:06:09.723166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89e8c6-2010-455f-a212-2bd093504272 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:09.723766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89e8c6-2010-455f-a212-2bd093504272 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:09.723766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89e8c6-2010-455f-a212-2bd093504272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:09.746808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0c89e8c6-2010-455f-a212-2bd093504272 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:06:09.748174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c89e8c6-2010-455f-a212-2bd093504272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:06:09.791508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:09.849339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 641/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:06:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:06:10.158367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356b758-0585-410a-9c99-3cf1fd026284 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:10.195978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:10.274391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356b758-0585-410a-9c99-3cf1fd026284 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:10.311970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4610fff-516f-4791-b6ee-d4912548c7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:10.312583 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610fff-516f-4791-b6ee-d4912548c7c0 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:10.312869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610fff-516f-4791-b6ee-d4912548c7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:10.313150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4610fff-516f-4791-b6ee-d4912548c7c0 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:10.313811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4610fff-516f-4791-b6ee-d4912548c7c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:10.315246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4610fff-516f-4791-b6ee-d4912548c7c0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:10.330073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 654/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 08:06:10 2022] POST /identity/v3/services => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:06:12.466086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb76-e4d3-43db-ac46-29db79949c57 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:12.466689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb76-e4d3-43db-ac46-29db79949c57 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:12.466777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb76-e4d3-43db-ac46-29db79949c57 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:12.468292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 642/1296] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:06:12.478486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324974-1c83-4d49-9f44-192572871818 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:12.479031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324974-1c83-4d49-9f44-192572871818 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:12.479186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324974-1c83-4d49-9f44-192572871818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:12.505698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0e324974-1c83-4d49-9f44-192572871818 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:06:12.509498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0e324974-1c83-4d49-9f44-192572871818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:06:12.610501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 655/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:06:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:06:12.905706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deeb76-e4d3-43db-ac46-29db79949c57 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:13.026383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deeb76-e4d3-43db-ac46-29db79949c57 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:13.065238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:13.065895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:13.066318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:13.066598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:13.067216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:13.068740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:13.078942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:13.080196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:13.081258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 643/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:06:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:06:13.087688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324974-1c83-4d49-9f44-192572871818 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:13.109010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:13.202016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324974-1c83-4d49-9f44-192572871818 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:13.239884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:13.240496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:13.240772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:13.241311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:13.242127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:13.242421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:13.243816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:13.249758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 656/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Sep 1 08:06:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:06:13.260848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:13.295119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:13.370899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096addb8-948e-4780-80cf-6fc70a68c13f None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:13.410067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976d754-d8b8-475c-94ec-b0a6501a13d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:13.410879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976d754-d8b8-475c-94ec-b0a6501a13d6 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:13.411155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976d754-d8b8-475c-94ec-b0a6501a13d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:13.411429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976d754-d8b8-475c-94ec-b0a6501a13d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:13.412156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976d754-d8b8-475c-94ec-b0a6501a13d6 None admin] RBAC: Adding query filter params (interface=public, service_id=f8b66499f78a4c28b57aa0f3e40b4480, region_id=RegionOne) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:13.412557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976d754-d8b8-475c-94ec-b0a6501a13d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:13.414121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976d754-d8b8-475c-94ec-b0a6501a13d6 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:13.419992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 644/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 08:06:13 2022] GET /identity/v3/endpoints?service_id=f8b66499f78a4c28b57aa0f3e40b4480&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:13.428833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:13.525434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:13.545709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceca52-17f8-43c0-8220-d732fe361755 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:13.582926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9233-b308-4bff-9024-0efebd68164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:13.583548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9233-b308-4bff-9024-0efebd68164e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:13.583834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9233-b308-4bff-9024-0efebd68164e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:13.584112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9233-b308-4bff-9024-0efebd68164e None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:13.584732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9233-b308-4bff-9024-0efebd68164e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:13.586950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9233-b308-4bff-9024-0efebd68164e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:13.594640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 657/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 08:06:13 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:06:15.798575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3d463-2e5f-46f6-9be7-ff248fc21d96 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:15.799198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3d463-2e5f-46f6-9be7-ff248fc21d96 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:15.799198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3d463-2e5f-46f6-9be7-ff248fc21d96 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:15.800545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 645/1302] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:06:15.807654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c61a3-1f57-4a48-8f7d-f345e57f0e9d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:15.808255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c61a3-1f57-4a48-8f7d-f345e57f0e9d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:15.808255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c61a3-1f57-4a48-8f7d-f345e57f0e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:15.828561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-605c61a3-1f57-4a48-8f7d-f345e57f0e9d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:06:15.829802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-605c61a3-1f57-4a48-8f7d-f345e57f0e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:06:15.916108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 658/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:06:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:06:16.191603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3d463-2e5f-46f6-9be7-ff248fc21d96 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:16.296931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:16.304617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3d463-2e5f-46f6-9be7-ff248fc21d96 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:16.341004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:16.341631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:16.341912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:16.342186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:16.342803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:16.344148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:16.353196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:16.354500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: ERROR keystone.server.flask.application Sep 01 08:06:16.355444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 646/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 08:06:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:06:16.361435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c61a3-1f57-4a48-8f7d-f345e57f0e9d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:16.441834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:16.466528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c61a3-1f57-4a48-8f7d-f345e57f0e9d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:16.503176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9704a6-6bd9-4376-a038-e53d0ed130a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:16.503784 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9704a6-6bd9-4376-a038-e53d0ed130a9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:16.504064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9704a6-6bd9-4376-a038-e53d0ed130a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:16.504351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9704a6-6bd9-4376-a038-e53d0ed130a9 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:16.504977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9704a6-6bd9-4376-a038-e53d0ed130a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:16.505301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9704a6-6bd9-4376-a038-e53d0ed130a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:16.506684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9704a6-6bd9-4376-a038-e53d0ed130a9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:16.512914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 659/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Sep 1 08:06:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:16.522139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:16.625316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65c46-5a83-47b4-be13-43fce5ab3a65 None admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:16.659626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412dff9-4b02-44bd-8062-5c77b0d5f42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:16.660238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412dff9-4b02-44bd-8062-5c77b0d5f42f None admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:16.660520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412dff9-4b02-44bd-8062-5c77b0d5f42f None admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:16.660795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412dff9-4b02-44bd-8062-5c77b0d5f42f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:16.661454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412dff9-4b02-44bd-8062-5c77b0d5f42f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:16.662847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412dff9-4b02-44bd-8062-5c77b0d5f42f None admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:16.682569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 647/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:06:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:06:26.509603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=30 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:26.677577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:23.763539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907865f-6f90-4da5-a2a0-c97b86534860 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:23.764104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907865f-6f90-4da5-a2a0-c97b86534860 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:23.764104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907865f-6f90-4da5-a2a0-c97b86534860 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:23.765717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 660/1307] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:23.772327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61d9d-3e2d-4f7c-97f0-f6df0c43e692 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:23.773419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61d9d-3e2d-4f7c-97f0-f6df0c43e692 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:23.773907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61d9d-3e2d-4f7c-97f0-f6df0c43e692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:23.859432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-43b61d9d-3e2d-4f7c-97f0-f6df0c43e692 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:23.861038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-43b61d9d-3e2d-4f7c-97f0-f6df0c43e692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:23.994896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 648/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:24.299737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc73f5-e59b-4776-891b-2e5375348804 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:24.300158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc73f5-e59b-4776-891b-2e5375348804 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:24.300333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc73f5-e59b-4776-891b-2e5375348804 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:24.301780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 661/1309] 10.222.0.43 () {54 vars in 965 bytes} [Thu Sep 1 08:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:24.318790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc979cc-1aff-4048-962a-7cbd0ff25e47 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:24.319456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc979cc-1aff-4048-962a-7cbd0ff25e47 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:24.319963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc979cc-1aff-4048-962a-7cbd0ff25e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:24.426537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9fc979cc-1aff-4048-962a-7cbd0ff25e47 None None] MFA Rules not processed for user `af3eef42cf30440aaf30f3ddb882fd04`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:24.428203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9fc979cc-1aff-4048-962a-7cbd0ff25e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:24.458374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:24.536854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 649/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Sep 1 08:07:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:24.546684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc73f5-e59b-4776-891b-2e5375348804 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:24.548597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8bbc73f5-e59b-4776-891b-2e5375348804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:24.692297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc73f5-e59b-4776-891b-2e5375348804 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:24.784002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c60ba-ed38-4d9c-998e-f9dabcc0130e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:24.787887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c60ba-ed38-4d9c-998e-f9dabcc0130e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:24.788516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c60ba-ed38-4d9c-998e-f9dabcc0130e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:24.789042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c60ba-ed38-4d9c-998e-f9dabcc0130e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:24.791518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e91c60ba-ed38-4d9c-998e-f9dabcc0130e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:24.858210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:24.929899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c60ba-ed38-4d9c-998e-f9dabcc0130e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:24.931756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c60ba-ed38-4d9c-998e-f9dabcc0130e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:24.956173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 662/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:27.282905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f5f50-47b5-431e-9aaa-e277e45f9d40 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:27.283771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f5f50-47b5-431e-9aaa-e277e45f9d40 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:27.283771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f5f50-47b5-431e-9aaa-e277e45f9d40 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:27.284949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 650/1312] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:27.292051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11347f74-151e-4e2c-bb57-a78e2f4519f2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:27.292678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11347f74-151e-4e2c-bb57-a78e2f4519f2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:27.292678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11347f74-151e-4e2c-bb57-a78e2f4519f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:27.385594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-11347f74-151e-4e2c-bb57-a78e2f4519f2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:27.386836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-11347f74-151e-4e2c-bb57-a78e2f4519f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:27.491831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 663/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:07:27.794646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf7b40-82f6-4eab-afa8-72a2e7b4e0ef None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:27.794930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf7b40-82f6-4eab-afa8-72a2e7b4e0ef None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:27.795205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf7b40-82f6-4eab-afa8-72a2e7b4e0ef None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:27.796538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 651/1314] 10.222.0.43 () {54 vars in 965 bytes} [Thu Sep 1 08:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:27.803386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af564a-cd6f-436a-8a9e-f74f13fc7e9d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:27.803785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af564a-cd6f-436a-8a9e-f74f13fc7e9d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:27.804079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af564a-cd6f-436a-8a9e-f74f13fc7e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:27.816341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:27.883218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-91af564a-cd6f-436a-8a9e-f74f13fc7e9d None None] MFA Rules not processed for user `af3eef42cf30440aaf30f3ddb882fd04`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:27.884463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-91af564a-cd6f-436a-8a9e-f74f13fc7e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:27.965329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 664/1315] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Sep 1 08:07:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:27.975328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf7b40-82f6-4eab-afa8-72a2e7b4e0ef None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:27.978019 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-63bf7b40-82f6-4eab-afa8-72a2e7b4e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:28.093581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf7b40-82f6-4eab-afa8-72a2e7b4e0ef None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:28.167849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:28.170990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f80485-a8e9-4af7-926e-173e96a1b4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:28.172040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80485-a8e9-4af7-926e-173e96a1b4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:28.172359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80485-a8e9-4af7-926e-173e96a1b4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:28.172815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80485-a8e9-4af7-926e-173e96a1b4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:28.175380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-23f80485-a8e9-4af7-926e-173e96a1b4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:28.292483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f80485-a8e9-4af7-926e-173e96a1b4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:28.293925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f80485-a8e9-4af7-926e-173e96a1b4d3 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:28.313098 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 652/1316] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:30.810715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e377d8-ef3e-41e9-83ac-fa077d6186f5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:30.811260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e377d8-ef3e-41e9-83ac-fa077d6186f5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:30.811260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e377d8-ef3e-41e9-83ac-fa077d6186f5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:30.812619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 665/1317] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:07:30.817947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e88f-7634-4c5e-bf9f-088ba3b30539 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:30.818516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e88f-7634-4c5e-bf9f-088ba3b30539 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:30.818791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e88f-7634-4c5e-bf9f-088ba3b30539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:30.897580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d382e88f-7634-4c5e-bf9f-088ba3b30539 None None] MFA Rules not processed for user `0036e4fc61fc440984148b32ad39f535`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:30.898850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d382e88f-7634-4c5e-bf9f-088ba3b30539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:30.954276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:31.002466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 653/1318] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:31.288260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e377d8-ef3e-41e9-83ac-fa077d6186f5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:31.289809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d0e377d8-ef3e-41e9-83ac-fa077d6186f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:31.424990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e377d8-ef3e-41e9-83ac-fa077d6186f5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:31.428794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:31.514763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d69856-b9b4-4e0c-abb2-0323079b9116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:31.515375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d69856-b9b4-4e0c-abb2-0323079b9116 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:31.515654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d69856-b9b4-4e0c-abb2-0323079b9116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:31.515930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d69856-b9b4-4e0c-abb2-0323079b9116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:31.517585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c8d69856-b9b4-4e0c-abb2-0323079b9116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:31.636535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d69856-b9b4-4e0c-abb2-0323079b9116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:31.637985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d69856-b9b4-4e0c-abb2-0323079b9116 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:31.657911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 666/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:34.379854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8131-2354-4592-bf1a-533b7ce9f40b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:34.381027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8131-2354-4592-bf1a-533b7ce9f40b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:34.381027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8131-2354-4592-bf1a-533b7ce9f40b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:34.382413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 654/1320] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:34.387767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014fb81-a463-4bf3-8f10-ca97bea9c333 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:34.388204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014fb81-a463-4bf3-8f10-ca97bea9c333 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:34.388325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014fb81-a463-4bf3-8f10-ca97bea9c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:34.429637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:34.456213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0014fb81-a463-4bf3-8f10-ca97bea9c333 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:34.457414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0014fb81-a463-4bf3-8f10-ca97bea9c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:34.557829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 667/1321] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:34.851486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8131-2354-4592-bf1a-533b7ce9f40b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:34.853008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-924c8131-2354-4592-bf1a-533b7ce9f40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:34.955090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8131-2354-4592-bf1a-533b7ce9f40b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:35.025644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d0af6-27e5-4f98-93cf-4dfcbc60429d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:35.026249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0af6-27e5-4f98-93cf-4dfcbc60429d service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:35.026554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0af6-27e5-4f98-93cf-4dfcbc60429d service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:35.026824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0af6-27e5-4f98-93cf-4dfcbc60429d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:35.028405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-577d0af6-27e5-4f98-93cf-4dfcbc60429d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:35.035807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:35.137103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d0af6-27e5-4f98-93cf-4dfcbc60429d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:35.138502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d0af6-27e5-4f98-93cf-4dfcbc60429d service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:35.157407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 655/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:37.872541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78c54-dd6d-433a-ba62-93b89542ec49 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:37.873112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78c54-dd6d-433a-ba62-93b89542ec49 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:37.873314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78c54-dd6d-433a-ba62-93b89542ec49 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:37.874749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 668/1323] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:37.881199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335200f-12f4-4b64-a5df-0d65d3388408 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:37.881694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335200f-12f4-4b64-a5df-0d65d3388408 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:37.881913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335200f-12f4-4b64-a5df-0d65d3388408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:37.948341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0335200f-12f4-4b64-a5df-0d65d3388408 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:37.949541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0335200f-12f4-4b64-a5df-0d65d3388408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:38.008834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:38.049512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 656/1324] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:38.337755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78c54-dd6d-433a-ba62-93b89542ec49 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:38.339331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aef78c54-dd6d-433a-ba62-93b89542ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:38.451408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78c54-dd6d-433a-ba62-93b89542ec49 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:38.464599 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:38.539473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffed2ec-a4b7-47de-b4a9-c75125dbfa69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:38.540104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffed2ec-a4b7-47de-b4a9-c75125dbfa69 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:38.540383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffed2ec-a4b7-47de-b4a9-c75125dbfa69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:38.540653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffed2ec-a4b7-47de-b4a9-c75125dbfa69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:38.542403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8ffed2ec-a4b7-47de-b4a9-c75125dbfa69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:38.655903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffed2ec-a4b7-47de-b4a9-c75125dbfa69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:38.657225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffed2ec-a4b7-47de-b4a9-c75125dbfa69 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:38.676177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 669/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:40.702039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ef72b-9f0d-4875-b1b0-888fdf4e098e None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:40.702587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ef72b-9f0d-4875-b1b0-888fdf4e098e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:40.702587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ef72b-9f0d-4875-b1b0-888fdf4e098e None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:40.703959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 657/1326] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:40.709603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339d653-d0be-4395-afe3-93c550678005 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:40.710031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339d653-d0be-4395-afe3-93c550678005 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:40.710172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339d653-d0be-4395-afe3-93c550678005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:40.770218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:40.793046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f339d653-d0be-4395-afe3-93c550678005 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:40.794307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f339d653-d0be-4395-afe3-93c550678005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:40.895951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 670/1327] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:41.180686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ef72b-9f0d-4875-b1b0-888fdf4e098e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:41.182249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ea9ef72b-9f0d-4875-b1b0-888fdf4e098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:41.295771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ef72b-9f0d-4875-b1b0-888fdf4e098e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:41.394085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b0b5e-969f-4df5-9449-1ce5cc982632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:41.394733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0b5e-969f-4df5-9449-1ce5cc982632 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:41.395011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0b5e-969f-4df5-9449-1ce5cc982632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:41.395281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b0b5e-969f-4df5-9449-1ce5cc982632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:41.396950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1b6b0b5e-969f-4df5-9449-1ce5cc982632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:41.415031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:41.552084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b0b5e-969f-4df5-9449-1ce5cc982632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:41.554657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b0b5e-969f-4df5-9449-1ce5cc982632 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:41.576442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 658/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:43.616828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114389ba-c646-418c-8eec-54b7d23b10d0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:43.617420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114389ba-c646-418c-8eec-54b7d23b10d0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:43.617420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114389ba-c646-418c-8eec-54b7d23b10d0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:43.618771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 671/1329] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:07:43.624700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345b34-30f3-4fb1-b133-5111cce0466a None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:43.625291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345b34-30f3-4fb1-b133-5111cce0466a None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:43.625387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3345b34-30f3-4fb1-b133-5111cce0466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:43.699655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e3345b34-30f3-4fb1-b133-5111cce0466a None None] MFA Rules not processed for user `0036e4fc61fc440984148b32ad39f535`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:43.700908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e3345b34-30f3-4fb1-b133-5111cce0466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:43.771805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:43.807977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 659/1330] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:44.099746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114389ba-c646-418c-8eec-54b7d23b10d0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:44.101336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-114389ba-c646-418c-8eec-54b7d23b10d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:44.230174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114389ba-c646-418c-8eec-54b7d23b10d0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:44.250804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:44.311869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c56e1-91bc-4630-8c62-aa4eeb1eabfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:44.312558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c56e1-91bc-4630-8c62-aa4eeb1eabfc service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:44.312838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c56e1-91bc-4630-8c62-aa4eeb1eabfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:44.313107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c56e1-91bc-4630-8c62-aa4eeb1eabfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:44.314803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb1c56e1-91bc-4630-8c62-aa4eeb1eabfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:44.440105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c56e1-91bc-4630-8c62-aa4eeb1eabfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:44.441559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c56e1-91bc-4630-8c62-aa4eeb1eabfc service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:44.463924 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 672/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:07:46.747644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7992-e3f5-47b4-ad3f-950b2a54c419 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:46.748153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7992-e3f5-47b4-ad3f-950b2a54c419 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:46.748153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7992-e3f5-47b4-ad3f-950b2a54c419 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:46.749450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 660/1332] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:46.754859 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5866de-2b1b-456c-9692-c77913bee1d5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:46.755311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5866de-2b1b-456c-9692-c77913bee1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:46.755521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5866de-2b1b-456c-9692-c77913bee1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:46.821748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:46.824807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-de5866de-2b1b-456c-9692-c77913bee1d5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:46.826635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-de5866de-2b1b-456c-9692-c77913bee1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:46.924534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 673/1333] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:47.216430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7992-e3f5-47b4-ad3f-950b2a54c419 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:47.217995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7cab7992-e3f5-47b4-ad3f-950b2a54c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:47.331327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7992-e3f5-47b4-ad3f-950b2a54c419 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:47.405585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d567d-ddc2-476d-b298-c97afbaf6938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:47.406196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d567d-ddc2-476d-b298-c97afbaf6938 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:47.406504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d567d-ddc2-476d-b298-c97afbaf6938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:47.406777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d567d-ddc2-476d-b298-c97afbaf6938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:47.408393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-848d567d-ddc2-476d-b298-c97afbaf6938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:47.436107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:47.575743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d567d-ddc2-476d-b298-c97afbaf6938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:47.578492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d567d-ddc2-476d-b298-c97afbaf6938 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:47.615310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 661/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:49.664761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441e52-dc16-478f-af3e-b64f8215e124 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:49.665346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441e52-dc16-478f-af3e-b64f8215e124 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:49.665346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441e52-dc16-478f-af3e-b64f8215e124 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:49.666739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 674/1335] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:49.673581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ac21-bc41-4c2e-8d28-04b8fa6f5627 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:49.674128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ac21-bc41-4c2e-8d28-04b8fa6f5627 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:49.674540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ac21-bc41-4c2e-8d28-04b8fa6f5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:49.765561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3166ac21-bc41-4c2e-8d28-04b8fa6f5627 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:49.766883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3166ac21-bc41-4c2e-8d28-04b8fa6f5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:49.844794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:49.869988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 662/1336] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:50.157997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36441e52-dc16-478f-af3e-b64f8215e124 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:50.159614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-36441e52-dc16-478f-af3e-b64f8215e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:50.270139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36441e52-dc16-478f-af3e-b64f8215e124 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:50.301840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:50.351377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad235d-1d0d-4cc0-a984-299b74a45f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:50.352000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad235d-1d0d-4cc0-a984-299b74a45f42 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:50.352281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad235d-1d0d-4cc0-a984-299b74a45f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:50.352554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad235d-1d0d-4cc0-a984-299b74a45f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:50.354203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-61ad235d-1d0d-4cc0-a984-299b74a45f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:50.469753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad235d-1d0d-4cc0-a984-299b74a45f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:50.471166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad235d-1d0d-4cc0-a984-299b74a45f42 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:50.493169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 675/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:52.841057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0e70-6109-453c-8c89-74eaf2eb0a33 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:52.841655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0e70-6109-453c-8c89-74eaf2eb0a33 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:52.841980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0e70-6109-453c-8c89-74eaf2eb0a33 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:52.844383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 663/1338] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:52.850517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5b6b6-e396-4b30-b118-da893ce0e961 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:52.851097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5b6b6-e396-4b30-b118-da893ce0e961 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:52.851097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5b6b6-e396-4b30-b118-da893ce0e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:52.926578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-62a5b6b6-e396-4b30-b118-da893ce0e961 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:52.927819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-62a5b6b6-e396-4b30-b118-da893ce0e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:52.937404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:53.037968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 676/1339] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:07:53.326141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a0e70-6109-453c-8c89-74eaf2eb0a33 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:53.327733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-010a0e70-6109-453c-8c89-74eaf2eb0a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:53.467939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a0e70-6109-453c-8c89-74eaf2eb0a33 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:53.560167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f3b11-823b-4bb7-ba86-2288eb8811a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:53.560793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3b11-823b-4bb7-ba86-2288eb8811a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:53.561074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3b11-823b-4bb7-ba86-2288eb8811a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:53.561345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3b11-823b-4bb7-ba86-2288eb8811a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:53.563061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-033f3b11-823b-4bb7-ba86-2288eb8811a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:53.617933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:53.706132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3b11-823b-4bb7-ba86-2288eb8811a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:53.707619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3b11-823b-4bb7-ba86-2288eb8811a1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:53.727720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 664/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:57.976634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b13fd-616c-47d2-b684-b6907819fc1d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:57.977208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b13fd-616c-47d2-b684-b6907819fc1d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:57.977208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b13fd-616c-47d2-b684-b6907819fc1d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:57.978613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 677/1341] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:57.984332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a83c-82d5-4fea-909d-6919e46b46d1 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:57.984883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a83c-82d5-4fea-909d-6919e46b46d1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:57.985025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415a83c-82d5-4fea-909d-6919e46b46d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:58.087846 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f415a83c-82d5-4fea-909d-6919e46b46d1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:58.089941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f415a83c-82d5-4fea-909d-6919e46b46d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:58.221112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:58.245908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 665/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:58.534904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b13fd-616c-47d2-b684-b6907819fc1d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:58.536814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-375b13fd-616c-47d2-b684-b6907819fc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:58.688164 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b13fd-616c-47d2-b684-b6907819fc1d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:58.756192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:58.808740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40151b-b195-453f-99b1-6b67bf16c251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:58.809364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40151b-b195-453f-99b1-6b67bf16c251 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:58.809647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40151b-b195-453f-99b1-6b67bf16c251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:58.809922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40151b-b195-453f-99b1-6b67bf16c251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:58.811676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dc40151b-b195-453f-99b1-6b67bf16c251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:58.947558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40151b-b195-453f-99b1-6b67bf16c251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:58.949026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40151b-b195-453f-99b1-6b67bf16c251 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:58.971206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 678/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:01.713419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed67e-0b22-4e4d-9baa-524d5d9f529b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:01.714374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed67e-0b22-4e4d-9baa-524d5d9f529b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:01.714374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed67e-0b22-4e4d-9baa-524d5d9f529b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:01.716266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 666/1344] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:01.723950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bba0b-5a24-45df-b7d0-0aafb8405de9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:01.724542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bba0b-5a24-45df-b7d0-0aafb8405de9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:01.724975 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bba0b-5a24-45df-b7d0-0aafb8405de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:01.827779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2b3bba0b-5a24-45df-b7d0-0aafb8405de9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:01.829650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2b3bba0b-5a24-45df-b7d0-0aafb8405de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:01.862575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:01.976064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 679/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:02.271807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ed67e-0b22-4e4d-9baa-524d5d9f529b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:02.273537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-205ed67e-0b22-4e4d-9baa-524d5d9f529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:02.415379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ed67e-0b22-4e4d-9baa-524d5d9f529b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:02.540725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa6a09-9fb1-42db-8110-a779376acd55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:02.541351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa6a09-9fb1-42db-8110-a779376acd55 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:02.541633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa6a09-9fb1-42db-8110-a779376acd55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:02.541909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa6a09-9fb1-42db-8110-a779376acd55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:02.543653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-16aa6a09-9fb1-42db-8110-a779376acd55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:02.599613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:02.687293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa6a09-9fb1-42db-8110-a779376acd55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:02.688769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa6a09-9fb1-42db-8110-a779376acd55 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:02.711148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 667/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:08:07.364889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b8a08-3d92-4463-acde-25326925aeb0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:07.365573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b8a08-3d92-4463-acde-25326925aeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:07.365573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b8a08-3d92-4463-acde-25326925aeb0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:07.366828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 680/1347] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:07.372523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a7562-f0ad-4ea2-ba30-c8ffed082c22 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:07.373031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a7562-f0ad-4ea2-ba30-c8ffed082c22 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:07.373179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a7562-f0ad-4ea2-ba30-c8ffed082c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:07.450626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ef6a7562-f0ad-4ea2-ba30-c8ffed082c22 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:07.451928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ef6a7562-f0ad-4ea2-ba30-c8ffed082c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:07.572938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:07.575917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 668/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:07.867405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b8a08-3d92-4463-acde-25326925aeb0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:07.868836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d60b8a08-3d92-4463-acde-25326925aeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:08.006490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b8a08-3d92-4463-acde-25326925aeb0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:08.058950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:08.086208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c16d8-933a-4d5f-ba87-c53406b69397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:08.086849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c16d8-933a-4d5f-ba87-c53406b69397 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:08.087130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c16d8-933a-4d5f-ba87-c53406b69397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:08.087401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c16d8-933a-4d5f-ba87-c53406b69397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:08.089036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1b9c16d8-933a-4d5f-ba87-c53406b69397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:08.208435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c16d8-933a-4d5f-ba87-c53406b69397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:08.209797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c16d8-933a-4d5f-ba87-c53406b69397 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:08.228941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 681/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:13.620416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83756fc6-0d2e-45d7-92f3-b4f3750ec8c3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:13.620915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83756fc6-0d2e-45d7-92f3-b4f3750ec8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:13.621410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83756fc6-0d2e-45d7-92f3-b4f3750ec8c3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:13.624285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 669/1350] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 08:08:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:13.631554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d948-4c7d-4b6f-a7fe-1f408c2d44e0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:13.632033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d948-4c7d-4b6f-a7fe-1f408c2d44e0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:13.632136 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d948-4c7d-4b6f-a7fe-1f408c2d44e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:13.770105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-39e4d948-4c7d-4b6f-a7fe-1f408c2d44e0 None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:13.775709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-39e4d948-4c7d-4b6f-a7fe-1f408c2d44e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:13.807588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:13.981740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 682/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 08:08:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:19.148848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea00c-7b0c-424a-80a5-7923452c9793 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:19.148848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea00c-7b0c-424a-80a5-7923452c9793 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:19.149799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea00c-7b0c-424a-80a5-7923452c9793 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:19.150394 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 670/1352] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 08:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:19.156284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f181-22d1-4bb1-a828-d49bd68609c0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:19.157147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f181-22d1-4bb1-a828-d49bd68609c0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:19.157600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347f181-22d1-4bb1-a828-d49bd68609c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:19.264008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e347f181-22d1-4bb1-a828-d49bd68609c0 None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:19.265867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e347f181-22d1-4bb1-a828-d49bd68609c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:19.417702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:19.492884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 683/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 08:08:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:20.736679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22e8d-c2af-4232-ae80-e739e61cc857 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:20.737535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22e8d-c2af-4232-ae80-e739e61cc857 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:20.737535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c22e8d-c2af-4232-ae80-e739e61cc857 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:20.739597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 671/1354] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 08:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:20.745155 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43078e43-2acf-43a4-92af-18d38e42dc88 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:20.746083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43078e43-2acf-43a4-92af-18d38e42dc88 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:20.746083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43078e43-2acf-43a4-92af-18d38e42dc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:20.844090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-43078e43-2acf-43a4-92af-18d38e42dc88 None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:20.845296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-43078e43-2acf-43a4-92af-18d38e42dc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:20.964321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 684/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:24.810212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb6c9a-e97c-4df5-82c8-573f1ec74506 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:24.810840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb6c9a-e97c-4df5-82c8-573f1ec74506 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:24.810840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb6c9a-e97c-4df5-82c8-573f1ec74506 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:24.812279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 672/1356] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:24.821449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a182-9b9e-4b45-bf73-88912a4c8d3d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:24.822278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a182-9b9e-4b45-bf73-88912a4c8d3d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:24.822278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a182-9b9e-4b45-bf73-88912a4c8d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:24.875358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:24.918078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fb00a182-9b9e-4b45-bf73-88912a4c8d3d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:24.919386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb00a182-9b9e-4b45-bf73-88912a4c8d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:25.100843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 685/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:25.433786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a929b-9117-40c4-aaa9-f49bb896611d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:25.434957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a929b-9117-40c4-aaa9-f49bb896611d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:25.435524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a929b-9117-40c4-aaa9-f49bb896611d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:25.438060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 673/1358] 10.222.0.43 () {54 vars in 962 bytes} [Thu Sep 1 08:08:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:25.451061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef427c-f7e2-4390-bbcb-9b5e03a2ccf5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:25.451450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef427c-f7e2-4390-bbcb-9b5e03a2ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:25.451627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef427c-f7e2-4390-bbcb-9b5e03a2ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:25.555040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-32ef427c-f7e2-4390-bbcb-9b5e03a2ccf5 None None] MFA Rules not processed for user `7949d9285d4e4c908c377a0ac16dd14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:25.558292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-32ef427c-f7e2-4390-bbcb-9b5e03a2ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:25.663192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:25.779030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 686/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Sep 1 08:08:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:25.794973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a929b-9117-40c4-aaa9-f49bb896611d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:25.798132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ba3a929b-9117-40c4-aaa9-f49bb896611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:26.056485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a929b-9117-40c4-aaa9-f49bb896611d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:26.206179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:26.291057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710f477-1069-4126-b134-3de6d249dcad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:26.292343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f477-1069-4126-b134-3de6d249dcad service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:26.292915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f477-1069-4126-b134-3de6d249dcad service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:26.293525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f477-1069-4126-b134-3de6d249dcad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:26.297272 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a710f477-1069-4126-b134-3de6d249dcad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:26.446176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f477-1069-4126-b134-3de6d249dcad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:26.447967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f477-1069-4126-b134-3de6d249dcad service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:26.477530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 674/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:28.788879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a476b8-6a5d-41fa-b285-eadec8806535 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:28.789555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a476b8-6a5d-41fa-b285-eadec8806535 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:28.789555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a476b8-6a5d-41fa-b285-eadec8806535 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:28.791152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 687/1361] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:28.798207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3974e-e5e4-43c1-8b83-c4bced66b112 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:28.798954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3974e-e5e4-43c1-8b83-c4bced66b112 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:28.799231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3974e-e5e4-43c1-8b83-c4bced66b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:28.942024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8cf3974e-e5e4-43c1-8b83-c4bced66b112 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:28.944150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8cf3974e-e5e4-43c1-8b83-c4bced66b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:29.021186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:29.158347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 675/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:29.630588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a476b8-6a5d-41fa-b285-eadec8806535 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:29.632427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e3a476b8-6a5d-41fa-b285-eadec8806535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:29.900120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a476b8-6a5d-41fa-b285-eadec8806535 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:29.917933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:30.099080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20a279-dacc-4ad4-918d-85e59c5d87e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:30.099787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a279-dacc-4ad4-918d-85e59c5d87e2 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:30.099991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a279-dacc-4ad4-918d-85e59c5d87e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:30.100264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a279-dacc-4ad4-918d-85e59c5d87e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:30.102209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8d20a279-dacc-4ad4-918d-85e59c5d87e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:30.259509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20a279-dacc-4ad4-918d-85e59c5d87e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:30.261540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20a279-dacc-4ad4-918d-85e59c5d87e2 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:30.291864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 688/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:32.992040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242338-7a3e-4617-b2a4-d30e4113a0a1 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:32.992704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242338-7a3e-4617-b2a4-d30e4113a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:32.992704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2242338-7a3e-4617-b2a4-d30e4113a0a1 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:32.994364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 676/1364] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:33.000442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5066e-a2f9-4e31-ab5c-e1af4d3c1f4f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:33.001008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5066e-a2f9-4e31-ab5c-e1af4d3c1f4f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:33.001093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5066e-a2f9-4e31-ab5c-e1af4d3c1f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:33.021181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:33.100628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d3e5066e-a2f9-4e31-ab5c-e1af4d3c1f4f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:33.102485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d3e5066e-a2f9-4e31-ab5c-e1af4d3c1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:33.229452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 689/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:33.711781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed456-9ab7-4f96-afa1-d824dca40006 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:33.712194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed456-9ab7-4f96-afa1-d824dca40006 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:33.712556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed456-9ab7-4f96-afa1-d824dca40006 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:33.714035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 677/1366] 10.222.0.43 () {54 vars in 962 bytes} [Thu Sep 1 08:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:08:33.719905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079555-ff72-42ba-8880-0ba6823297a6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:33.720178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079555-ff72-42ba-8880-0ba6823297a6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:33.720508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079555-ff72-42ba-8880-0ba6823297a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:33.806424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ad079555-ff72-42ba-8880-0ba6823297a6 None None] MFA Rules not processed for user `7949d9285d4e4c908c377a0ac16dd14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:33.807647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ad079555-ff72-42ba-8880-0ba6823297a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:33.845280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:33.936811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 690/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Sep 1 08:08:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:33.945336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ed456-9ab7-4f96-afa1-d824dca40006 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:33.947795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f28ed456-9ab7-4f96-afa1-d824dca40006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:34.240909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ed456-9ab7-4f96-afa1-d824dca40006 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:34.283144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:34.476792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421acd53-f47c-4f97-8676-fb51aea08309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:34.478013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421acd53-f47c-4f97-8676-fb51aea08309 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:34.478396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421acd53-f47c-4f97-8676-fb51aea08309 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:34.478742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421acd53-f47c-4f97-8676-fb51aea08309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:34.481829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-421acd53-f47c-4f97-8676-fb51aea08309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:34.615546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421acd53-f47c-4f97-8676-fb51aea08309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:34.617328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421acd53-f47c-4f97-8676-fb51aea08309 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:34.641182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 678/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:08:34.923149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506f82-204d-46dc-8b11-f9a41bdaa616 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:34.924074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506f82-204d-46dc-8b11-f9a41bdaa616 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:34.924359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506f82-204d-46dc-8b11-f9a41bdaa616 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:34.927464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 691/1369] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:34.935808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeffe6-f9ec-43df-9731-9a2ee33fc0c0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:34.936454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeffe6-f9ec-43df-9731-9a2ee33fc0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:34.936784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeffe6-f9ec-43df-9731-9a2ee33fc0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:34.991693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:35.043984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-61eeffe6-f9ec-43df-9731-9a2ee33fc0c0 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:35.045763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-61eeffe6-f9ec-43df-9731-9a2ee33fc0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:35.184911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 679/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:35.929564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c540e0-d992-4f6d-9147-41d16a20d5a0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:35.930403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c540e0-d992-4f6d-9147-41d16a20d5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:35.933791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c540e0-d992-4f6d-9147-41d16a20d5a0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:35.937455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 692/1371] 10.222.0.43 () {54 vars in 964 bytes} [Thu Sep 1 08:08:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:35.944522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf136c-159d-49bc-8ad5-178cd0a1239b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:35.945195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf136c-159d-49bc-8ad5-178cd0a1239b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:35.945195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf136c-159d-49bc-8ad5-178cd0a1239b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:36.034554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-55bf136c-159d-49bc-8ad5-178cd0a1239b None None] MFA Rules not processed for user `8c37ab868df74cd5a36323f7db5699d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:36.035852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-55bf136c-159d-49bc-8ad5-178cd0a1239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:36.084581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:36.116782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 680/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Sep 1 08:08:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:36.124392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c540e0-d992-4f6d-9147-41d16a20d5a0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:36.126038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-49c540e0-d992-4f6d-9147-41d16a20d5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:36.255172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c540e0-d992-4f6d-9147-41d16a20d5a0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:36.297914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:36.338530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb18ca-0969-444a-986d-7da5a282f42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:36.339185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb18ca-0969-444a-986d-7da5a282f42c service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:36.339547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb18ca-0969-444a-986d-7da5a282f42c service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:36.339824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb18ca-0969-444a-986d-7da5a282f42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:36.341473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f0eb18ca-0969-444a-986d-7da5a282f42c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:36.472118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb18ca-0969-444a-986d-7da5a282f42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:36.473905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb18ca-0969-444a-986d-7da5a282f42c service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:36.497195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 693/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:08:36.800555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb10abd-0846-4bd1-9bec-b83592342420 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:36.800860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb10abd-0846-4bd1-9bec-b83592342420 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:36.801097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb10abd-0846-4bd1-9bec-b83592342420 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:36.802553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 681/1374] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:36.808343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe114d7-c744-4d44-b059-af23a99d2529 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:36.808662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe114d7-c744-4d44-b059-af23a99d2529 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:36.808939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe114d7-c744-4d44-b059-af23a99d2529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:36.878773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dfe114d7-c744-4d44-b059-af23a99d2529 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:36.880524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dfe114d7-c744-4d44-b059-af23a99d2529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:36.901118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:37.107689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 694/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:37.414602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb10abd-0846-4bd1-9bec-b83592342420 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:37.416170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5fb10abd-0846-4bd1-9bec-b83592342420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:37.580132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb10abd-0846-4bd1-9bec-b83592342420 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:37.639337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:37.711204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f0450-f873-4fc5-8996-a3625ed9a963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:37.711831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f0450-f873-4fc5-8996-a3625ed9a963 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:37.712215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f0450-f873-4fc5-8996-a3625ed9a963 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:37.712568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f0450-f873-4fc5-8996-a3625ed9a963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:37.714825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c23f0450-f873-4fc5-8996-a3625ed9a963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:37.837850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f0450-f873-4fc5-8996-a3625ed9a963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:37.839505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f0450-f873-4fc5-8996-a3625ed9a963 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:37.863627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 682/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:39.886839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6b12-70d6-4038-95f8-92520f4753c5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:39.887373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6b12-70d6-4038-95f8-92520f4753c5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:39.887373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6b12-70d6-4038-95f8-92520f4753c5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:39.889363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 695/1377] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:39.896468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68732790-1579-40f6-92a1-9f28b3e37643 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:39.897024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68732790-1579-40f6-92a1-9f28b3e37643 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:39.897024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68732790-1579-40f6-92a1-9f28b3e37643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:39.990393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-68732790-1579-40f6-92a1-9f28b3e37643 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:39.991628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-68732790-1579-40f6-92a1-9f28b3e37643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:39.999233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:40.115946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 683/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:40.492999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda6b12-70d6-4038-95f8-92520f4753c5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:40.494759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6dda6b12-70d6-4038-95f8-92520f4753c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:40.715772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda6b12-70d6-4038-95f8-92520f4753c5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:40.720477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:40.871834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d855d9-f978-4970-86b5-6aaaf2a1be01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:40.872960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d855d9-f978-4970-86b5-6aaaf2a1be01 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:40.873423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d855d9-f978-4970-86b5-6aaaf2a1be01 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:40.873859 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d855d9-f978-4970-86b5-6aaaf2a1be01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:40.876775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c6d855d9-f978-4970-86b5-6aaaf2a1be01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:41.031135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d855d9-f978-4970-86b5-6aaaf2a1be01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:41.033138 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d855d9-f978-4970-86b5-6aaaf2a1be01 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:41.068756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 696/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:43.465128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c068f-6a2b-4e2f-a979-e5fb227409f6 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:43.465816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c068f-6a2b-4e2f-a979-e5fb227409f6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:43.465816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c068f-6a2b-4e2f-a979-e5fb227409f6 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:43.472892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 684/1380] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:43.475454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384d0f7-0751-4e45-a3b5-38df591ae7e8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:43.476099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384d0f7-0751-4e45-a3b5-38df591ae7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:43.476770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384d0f7-0751-4e45-a3b5-38df591ae7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:43.497025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:43.564453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7384d0f7-0751-4e45-a3b5-38df591ae7e8 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:43.566204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7384d0f7-0751-4e45-a3b5-38df591ae7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:43.742324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 697/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:44.054142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c068f-6a2b-4e2f-a979-e5fb227409f6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:44.055926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e87c068f-6a2b-4e2f-a979-e5fb227409f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:44.264704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:44.279324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c068f-6a2b-4e2f-a979-e5fb227409f6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:44.427903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6726f-38ba-4fe7-8455-d5a558eadc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:44.428715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6726f-38ba-4fe7-8455-d5a558eadc3c service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:44.429092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6726f-38ba-4fe7-8455-d5a558eadc3c service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:44.429462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6726f-38ba-4fe7-8455-d5a558eadc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:44.432027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-33e6726f-38ba-4fe7-8455-d5a558eadc3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:44.551944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6726f-38ba-4fe7-8455-d5a558eadc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:44.553713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6726f-38ba-4fe7-8455-d5a558eadc3c service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:44.566058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:44.577142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 685/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:46.690745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81bb8a-0a31-4d58-affc-695862e99d03 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:46.691644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81bb8a-0a31-4d58-affc-695862e99d03 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:46.691644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81bb8a-0a31-4d58-affc-695862e99d03 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:46.692888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 698/1383] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:46.699688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbcb3a-6501-4deb-ba8c-93c9a288cc28 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:46.700212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbcb3a-6501-4deb-ba8c-93c9a288cc28 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:46.700692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbcb3a-6501-4deb-ba8c-93c9a288cc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:46.795656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-43cbcb3a-6501-4deb-ba8c-93c9a288cc28 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:46.796894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-43cbcb3a-6501-4deb-ba8c-93c9a288cc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:46.930689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 686/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:47.239743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81bb8a-0a31-4d58-affc-695862e99d03 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:47.241345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a81bb8a-0a31-4d58-affc-695862e99d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:47.362492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:47.449056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81bb8a-0a31-4d58-affc-695862e99d03 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:47.615173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a409b3f-bfb4-4da0-bd7f-893fd5b34353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:47.615805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a409b3f-bfb4-4da0-bd7f-893fd5b34353 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:47.616094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a409b3f-bfb4-4da0-bd7f-893fd5b34353 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:47.616375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a409b3f-bfb4-4da0-bd7f-893fd5b34353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:47.618041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1a409b3f-bfb4-4da0-bd7f-893fd5b34353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:47.707419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:47.778721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a409b3f-bfb4-4da0-bd7f-893fd5b34353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:47.782678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a409b3f-bfb4-4da0-bd7f-893fd5b34353 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:47.825097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 699/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:49.969921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244a4f3-d4b1-4ed9-9be6-26b757b1eb84 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:49.971100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244a4f3-d4b1-4ed9-9be6-26b757b1eb84 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:49.971100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244a4f3-d4b1-4ed9-9be6-26b757b1eb84 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:49.972985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 687/1386] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:49.981674 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60396ba-a506-4dff-8938-3bba6dbdd032 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:49.982249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60396ba-a506-4dff-8938-3bba6dbdd032 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:49.982759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60396ba-a506-4dff-8938-3bba6dbdd032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:50.082283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a60396ba-a506-4dff-8938-3bba6dbdd032 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:50.083600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a60396ba-a506-4dff-8938-3bba6dbdd032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:50.220561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 700/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:50.628484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244a4f3-d4b1-4ed9-9be6-26b757b1eb84 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:50.630317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1244a4f3-d4b1-4ed9-9be6-26b757b1eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:50.749250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:50.840860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244a4f3-d4b1-4ed9-9be6-26b757b1eb84 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:51.024952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5940e75-5a0b-4fef-9b58-4f37c36ea57d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:51.025918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5940e75-5a0b-4fef-9b58-4f37c36ea57d service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:51.026477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5940e75-5a0b-4fef-9b58-4f37c36ea57d service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:51.026984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5940e75-5a0b-4fef-9b58-4f37c36ea57d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:51.030215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b5940e75-5a0b-4fef-9b58-4f37c36ea57d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:51.084433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:51.158796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5940e75-5a0b-4fef-9b58-4f37c36ea57d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:51.162560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5940e75-5a0b-4fef-9b58-4f37c36ea57d service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:51.190916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 688/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:52.688536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be98e-ac1a-49f7-b75f-511947c38e67 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:52.689094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be98e-ac1a-49f7-b75f-511947c38e67 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:52.689094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be98e-ac1a-49f7-b75f-511947c38e67 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:52.690803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 701/1389] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:52.696634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98eb99-0f2f-4265-a3f3-b6397efea2f5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:52.697186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98eb99-0f2f-4265-a3f3-b6397efea2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:52.697186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98eb99-0f2f-4265-a3f3-b6397efea2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:52.768946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bd98eb99-0f2f-4265-a3f3-b6397efea2f5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:52.770183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bd98eb99-0f2f-4265-a3f3-b6397efea2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:52.877177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 689/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:53.193557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defda60-2b72-459b-9ce9-c9b5e0a97370 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:53.193839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defda60-2b72-459b-9ce9-c9b5e0a97370 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:53.194112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defda60-2b72-459b-9ce9-c9b5e0a97370 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:53.195710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 702/1391] 10.222.0.43 () {54 vars in 967 bytes} [Thu Sep 1 08:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:53.204406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25089a-6866-477b-81d9-ca321d4073a9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:53.204715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25089a-6866-477b-81d9-ca321d4073a9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:53.205735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25089a-6866-477b-81d9-ca321d4073a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:53.224364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:53.320031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7c25089a-6866-477b-81d9-ca321d4073a9 None None] MFA Rules not processed for user `d9452756fb5049678dd3aac0d5be651d`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:53.321262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7c25089a-6866-477b-81d9-ca321d4073a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:53.359101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f37a-df1a-4e55-a541-dae3786095d3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:53.359460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f37a-df1a-4e55-a541-dae3786095d3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:53.359679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f37a-df1a-4e55-a541-dae3786095d3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:53.361015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 703/1392] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:08:53.366910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d80f2-162b-4a06-a10a-c5549eb364ec None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:53.367197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d80f2-162b-4a06-a10a-c5549eb364ec None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:53.367474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d80f2-162b-4a06-a10a-c5549eb364ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:53.406990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 690/1393] 10.222.0.43 () {58 vars in 1064 bytes} [Thu Sep 1 08:08:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:53.408870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:53.415801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25089a-6866-477b-81d9-ca321d4073a9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:53.424485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25089a-6866-477b-81d9-ca321d4073a9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:53.449099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-356d80f2-162b-4a06-a10a-c5549eb364ec None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:53.450398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-356d80f2-162b-4a06-a10a-c5549eb364ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:53.513373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35252364-e073-455d-8ff4-9b9579c9e7be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9452756fb5049678dd3aac0d5be651d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:53.514055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252364-e073-455d-8ff4-9b9579c9e7be service glance] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:53.514274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252364-e073-455d-8ff4-9b9579c9e7be service glance] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:53.514553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252364-e073-455d-8ff4-9b9579c9e7be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:53.516158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-35252364-e073-455d-8ff4-9b9579c9e7be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:53.559699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 704/1394] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:53.562529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:53.660065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35252364-e073-455d-8ff4-9b9579c9e7be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:53.661818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35252364-e073-455d-8ff4-9b9579c9e7be service glance] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:53.682052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 691/1395] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:08:53.878003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d80f2-162b-4a06-a10a-c5549eb364ec None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:53.880815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-356d80f2-162b-4a06-a10a-c5549eb364ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:54.014581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:54.024736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d80f2-162b-4a06-a10a-c5549eb364ec None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:54.156346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186ffe2-6bed-4d83-94c2-4656e9320843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:54.156957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ffe2-6bed-4d83-94c2-4656e9320843 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:54.157243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ffe2-6bed-4d83-94c2-4656e9320843 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:54.157504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186ffe2-6bed-4d83-94c2-4656e9320843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:54.159194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3186ffe2-6bed-4d83-94c2-4656e9320843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:54.265587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186ffe2-6bed-4d83-94c2-4656e9320843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:54.267154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186ffe2-6bed-4d83-94c2-4656e9320843 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:54.284922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:54.290471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 705/1396] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:54.487135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a22da8-9e8f-4e94-bddb-915a51727cf6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:54.487855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a22da8-9e8f-4e94-bddb-915a51727cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:54.487855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a22da8-9e8f-4e94-bddb-915a51727cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:54.579011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-03a22da8-9e8f-4e94-bddb-915a51727cf6 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:54.580968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-03a22da8-9e8f-4e94-bddb-915a51727cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:54.668170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:54.678576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 692/1397] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:08:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:54.729347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2d7db-e93c-4319-8c02-b97f263467ac None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:54.729856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2d7db-e93c-4319-8c02-b97f263467ac None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:54.730307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2d7db-e93c-4319-8c02-b97f263467ac None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:54.732099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 706/1398] 10.222.0.43 () {54 vars in 943 bytes} [Thu Sep 1 08:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:54.739934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fc53-4b10-4762-9cae-317f3e7fc895 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:54.740221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fc53-4b10-4762-9cae-317f3e7fc895 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:54.740496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fc53-4b10-4762-9cae-317f3e7fc895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:54.825807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d8f8fc53-4b10-4762-9cae-317f3e7fc895 None None] MFA Rules not processed for user `ef9aa824aafe4c499df84fa0c3fe3f42`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:54.827179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d8f8fc53-4b10-4762-9cae-317f3e7fc895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:54.958760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 693/1399] 10.222.0.43 () {58 vars in 1040 bytes} [Thu Sep 1 08:08:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:54.968485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2d7db-e93c-4319-8c02-b97f263467ac None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:54.970453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4df2d7db-e93c-4319-8c02-b97f263467ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:55.141796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2d7db-e93c-4319-8c02-b97f263467ac None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:55.254078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:55.282715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247028af-20a4-493e-9724-8f8dd841ad40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:55.287033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247028af-20a4-493e-9724-8f8dd841ad40 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:55.287328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247028af-20a4-493e-9724-8f8dd841ad40 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:55.287613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247028af-20a4-493e-9724-8f8dd841ad40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:55.289377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-247028af-20a4-493e-9724-8f8dd841ad40 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:55.389426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247028af-20a4-493e-9724-8f8dd841ad40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:55.391781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247028af-20a4-493e-9724-8f8dd841ad40 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:55.405222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 707/1400] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:08:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:08:56.403646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850560a5-a1e1-401e-802e-a490e5431aaf None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:56.404238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850560a5-a1e1-401e-802e-a490e5431aaf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:56.404238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850560a5-a1e1-401e-802e-a490e5431aaf None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:56.405533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 694/1401] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:56.411464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada14169-be43-4bfa-ab49-e9ac4374f7de None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:56.412397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada14169-be43-4bfa-ab49-e9ac4374f7de None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:56.412682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada14169-be43-4bfa-ab49-e9ac4374f7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:56.498040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ada14169-be43-4bfa-ab49-e9ac4374f7de None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:56.499316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ada14169-be43-4bfa-ab49-e9ac4374f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:56.578587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:56.619191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 708/1402] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:56.913763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850560a5-a1e1-401e-802e-a490e5431aaf None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:56.915373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-850560a5-a1e1-401e-802e-a490e5431aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:56.982099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:57.086514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850560a5-a1e1-401e-802e-a490e5431aaf None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:57.250351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c232f-f940-4817-810e-165b19fb33c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:57.251784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c232f-f940-4817-810e-165b19fb33c8 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:57.252645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c232f-f940-4817-810e-165b19fb33c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:57.252993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c232f-f940-4817-810e-165b19fb33c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:57.254846 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-838c232f-f940-4817-810e-165b19fb33c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:57.275561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:57.381693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c232f-f940-4817-810e-165b19fb33c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:57.383444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c232f-f940-4817-810e-165b19fb33c8 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:57.404549 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 695/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:59.455582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd33c4-aa3d-49c3-9bd3-a80e3575fe0a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:59.456284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd33c4-aa3d-49c3-9bd3-a80e3575fe0a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:59.456284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd33c4-aa3d-49c3-9bd3-a80e3575fe0a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:59.457554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 709/1404] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:59.463356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc05eb3-df52-4014-902a-e8750865e513 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:59.463852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc05eb3-df52-4014-902a-e8750865e513 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:59.463974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc05eb3-df52-4014-902a-e8750865e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:59.555031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fcc05eb3-df52-4014-902a-e8750865e513 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:59.555701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fcc05eb3-df52-4014-902a-e8750865e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:59.663866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:59.674237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 696/1405] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:59.982993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd33c4-aa3d-49c3-9bd3-a80e3575fe0a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:59.984535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-87dd33c4-aa3d-49c3-9bd3-a80e3575fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:00.166746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd33c4-aa3d-49c3-9bd3-a80e3575fe0a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:00.250561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:00.325916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4865a8-d13a-469c-84e8-974a6e05212c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:00.325916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4865a8-d13a-469c-84e8-974a6e05212c service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:00.326389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4865a8-d13a-469c-84e8-974a6e05212c service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:00.326389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4865a8-d13a-469c-84e8-974a6e05212c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:00.328050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5a4865a8-d13a-469c-84e8-974a6e05212c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:00.432958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4865a8-d13a-469c-84e8-974a6e05212c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:00.434612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4865a8-d13a-469c-84e8-974a6e05212c service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:00.459311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 710/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:02.464299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e028b-614f-49c3-b623-c6ecc7c6dbba None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:02.464888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e028b-614f-49c3-b623-c6ecc7c6dbba None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:02.464888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e028b-614f-49c3-b623-c6ecc7c6dbba None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:02.466360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 697/1407] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:02.472447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c1bd-5fc5-4263-a4c6-404e7e814028 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:02.472965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c1bd-5fc5-4263-a4c6-404e7e814028 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:02.473084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8c1bd-5fc5-4263-a4c6-404e7e814028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:02.602278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-11f8c1bd-5fc5-4263-a4c6-404e7e814028 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:02.602278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-11f8c1bd-5fc5-4263-a4c6-404e7e814028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:02.602278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:02.766694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 711/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:03.068446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e028b-614f-49c3-b623-c6ecc7c6dbba None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:03.069973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-374e028b-614f-49c3-b623-c6ecc7c6dbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:03.248864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e028b-614f-49c3-b623-c6ecc7c6dbba None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:03.322131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:03.381252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c6fe5-e15c-421b-b9e2-651eed506d27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:03.381931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6fe5-e15c-421b-b9e2-651eed506d27 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:03.382213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6fe5-e15c-421b-b9e2-651eed506d27 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:03.382514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6fe5-e15c-421b-b9e2-651eed506d27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:03.384313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-879c6fe5-e15c-421b-b9e2-651eed506d27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:03.489512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c6fe5-e15c-421b-b9e2-651eed506d27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:03.491420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c6fe5-e15c-421b-b9e2-651eed506d27 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:03.510901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 698/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:12.762042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=37 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:13.508138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=65 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:18.456745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce5ae5-5e37-4052-a0fb-cebf7482afa9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:18.457365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce5ae5-5e37-4052-a0fb-cebf7482afa9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:18.457365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce5ae5-5e37-4052-a0fb-cebf7482afa9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:18.458669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 712/1410] 10.222.0.43 () {54 vars in 918 bytes} [Thu Sep 1 08:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:18.463814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e8cb-259a-4c73-bfa3-2722a4620b17 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:18.464254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e8cb-259a-4c73-bfa3-2722a4620b17 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:18.464352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e8cb-259a-4c73-bfa3-2722a4620b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:18.543297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a9b8e8cb-259a-4c73-bfa3-2722a4620b17 None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:18.544518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a9b8e8cb-259a-4c73-bfa3-2722a4620b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:18.653507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 699/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 1 08:09:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:09:18.668783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328dc1-31cb-4ca6-93ba-2cf2c21cd17b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:18.669071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328dc1-31cb-4ca6-93ba-2cf2c21cd17b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:18.669352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328dc1-31cb-4ca6-93ba-2cf2c21cd17b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:18.670764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 713/1412] 10.222.0.43 () {54 vars in 918 bytes} [Thu Sep 1 08:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:18.676924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7228b-3150-4669-a903-5d9dc587f3b6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:18.677210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7228b-3150-4669-a903-5d9dc587f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:18.677490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7228b-3150-4669-a903-5d9dc587f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:18.751054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:18.755326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-41e7228b-3150-4669-a903-5d9dc587f3b6 None None] MFA Rules not processed for user `7949d9285d4e4c908c377a0ac16dd14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:18.757069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-41e7228b-3150-4669-a903-5d9dc587f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:18.876455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 700/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 1 08:09:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:21.292228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8780-3ad4-4c79-9c60-269aaddddec6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:21.292785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8780-3ad4-4c79-9c60-269aaddddec6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:21.292785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8780-3ad4-4c79-9c60-269aaddddec6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:21.294122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:21.300233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a7d6-811c-404f-8b42-7de17bcbf468 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:21.300773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a7d6-811c-404f-8b42-7de17bcbf468 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:21.300773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a7d6-811c-404f-8b42-7de17bcbf468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:21.371128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7cb0a7d6-811c-404f-8b42-7de17bcbf468 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:21.372334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7cb0a7d6-811c-404f-8b42-7de17bcbf468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:21.428252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:21.470968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:21.762131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8780-3ad4-4c79-9c60-269aaddddec6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:21.763585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bdad8780-3ad4-4c79-9c60-269aaddddec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:21.915388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8780-3ad4-4c79-9c60-269aaddddec6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:21.989031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:22.029852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf2d7b-c115-4344-86b2-7f99a45faedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:22.030488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2d7b-c115-4344-86b2-7f99a45faedb service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:22.030767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2d7b-c115-4344-86b2-7f99a45faedb service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:22.031041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf2d7b-c115-4344-86b2-7f99a45faedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:22.032647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2faf2d7b-c115-4344-86b2-7f99a45faedb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:22.123389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf2d7b-c115-4344-86b2-7f99a45faedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:22.124980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf2d7b-c115-4344-86b2-7f99a45faedb service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:22.143797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 715/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:23.056800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a161d-5c9a-4965-9940-93739de18048 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:23.057361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a161d-5c9a-4965-9940-93739de18048 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:23.057361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a161d-5c9a-4965-9940-93739de18048 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:23.058755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:23.063671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42114-831a-459a-b4e6-19ff0c2d90a6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:23.064134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42114-831a-459a-b4e6-19ff0c2d90a6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:23.064237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42114-831a-459a-b4e6-19ff0c2d90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:23.144701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e6f42114-831a-459a-b4e6-19ff0c2d90a6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:23.145930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e6f42114-831a-459a-b4e6-19ff0c2d90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:23.174317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:23.253356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:23.405022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a161d-5c9a-4965-9940-93739de18048 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:23.406516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-947a161d-5c9a-4965-9940-93739de18048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:23.558230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a161d-5c9a-4965-9940-93739de18048 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:23.599886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:23.682197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806f16-9753-455b-b226-684d5dfe212e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:23.682854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806f16-9753-455b-b226-684d5dfe212e service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:23.683135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806f16-9753-455b-b226-684d5dfe212e service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:23.683407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806f16-9753-455b-b226-684d5dfe212e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:23.685060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9c806f16-9753-455b-b226-684d5dfe212e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:23.789183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806f16-9753-455b-b226-684d5dfe212e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:23.790976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806f16-9753-455b-b226-684d5dfe212e service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:23.808878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 703/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:24.715727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f72e68-767b-4165-a8cd-4163429cedf3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:24.716247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f72e68-767b-4165-a8cd-4163429cedf3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:24.716247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f72e68-767b-4165-a8cd-4163429cedf3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:24.717540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:24.723236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a726-b898-4121-ad21-845d15fa3ead None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:24.723685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a726-b898-4121-ad21-845d15fa3ead None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:24.723784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19a726-b898-4121-ad21-845d15fa3ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:24.785698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:24.809382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1d19a726-b898-4121-ad21-845d15fa3ead None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:24.810656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1d19a726-b898-4121-ad21-845d15fa3ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:24.911106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:25.060824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f72e68-767b-4165-a8cd-4163429cedf3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:25.062377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-91f72e68-767b-4165-a8cd-4163429cedf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:25.212391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f72e68-767b-4165-a8cd-4163429cedf3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:25.225367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:25.330917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d862fa-19c9-4789-b1f1-d549be1ff440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:25.331449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d862fa-19c9-4789-b1f1-d549be1ff440 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:25.331726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d862fa-19c9-4789-b1f1-d549be1ff440 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:25.331997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d862fa-19c9-4789-b1f1-d549be1ff440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:25.333606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-63d862fa-19c9-4789-b1f1-d549be1ff440 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:25.424103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d862fa-19c9-4789-b1f1-d549be1ff440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:25.425683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d862fa-19c9-4789-b1f1-d549be1ff440 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:25.444436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 718/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:26.355700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b05dd0-9e31-42e8-ae92-6c22283f40f5 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:26.356106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b05dd0-9e31-42e8-ae92-6c22283f40f5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:26.356409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b05dd0-9e31-42e8-ae92-6c22283f40f5 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:26.357838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:26.363433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb2e2-b0ac-4fb7-aab6-0f30f586ff3e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:26.363898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb2e2-b0ac-4fb7-aab6-0f30f586ff3e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:26.364013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb2e2-b0ac-4fb7-aab6-0f30f586ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:26.386209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:26.450529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ba2fb2e2-b0ac-4fb7-aab6-0f30f586ff3e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:26.451766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ba2fb2e2-b0ac-4fb7-aab6-0f30f586ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:26.555162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:26.708656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b05dd0-9e31-42e8-ae92-6c22283f40f5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:26.710106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-93b05dd0-9e31-42e8-ae92-6c22283f40f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:26.856704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:26.898749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b05dd0-9e31-42e8-ae92-6c22283f40f5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:27.019159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270aa59-01d6-422a-9891-5fb863251982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:27.019709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270aa59-01d6-422a-9891-5fb863251982 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:27.019987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270aa59-01d6-422a-9891-5fb863251982 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:27.020283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270aa59-01d6-422a-9891-5fb863251982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:27.021885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f270aa59-01d6-422a-9891-5fb863251982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:27.105130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:27.122310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270aa59-01d6-422a-9891-5fb863251982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:27.123886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270aa59-01d6-422a-9891-5fb863251982 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:27.144408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 706/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:28.049099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e191d3-ac10-469c-a076-8393570215f7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:28.049649 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e191d3-ac10-469c-a076-8393570215f7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:28.049829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e191d3-ac10-469c-a076-8393570215f7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:28.051084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:28.056229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb628-9894-4ac2-9223-ac0f694f7f41 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:28.056671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb628-9894-4ac2-9223-ac0f694f7f41 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:28.056843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb628-9894-4ac2-9223-ac0f694f7f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:28.133440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2e0fb628-9894-4ac2-9223-ac0f694f7f41 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:28.134679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2e0fb628-9894-4ac2-9223-ac0f694f7f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:28.234620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:28.387527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e191d3-ac10-469c-a076-8393570215f7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:28.388981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f8e191d3-ac10-469c-a076-8393570215f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:28.484653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:28.547699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e191d3-ac10-469c-a076-8393570215f7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:28.665034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195934ae-c344-4fad-ba3b-1c89ea85e29e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:28.665567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195934ae-c344-4fad-ba3b-1c89ea85e29e service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:28.665849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195934ae-c344-4fad-ba3b-1c89ea85e29e service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:28.666125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195934ae-c344-4fad-ba3b-1c89ea85e29e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:28.667774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-195934ae-c344-4fad-ba3b-1c89ea85e29e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:28.719806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:28.763840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195934ae-c344-4fad-ba3b-1c89ea85e29e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:28.765424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195934ae-c344-4fad-ba3b-1c89ea85e29e service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:28.783841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 721/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:29.604003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38ce9-ea03-49e9-b09a-33636c4696be None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:29.604599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38ce9-ea03-49e9-b09a-33636c4696be None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:29.604599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d38ce9-ea03-49e9-b09a-33636c4696be None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:29.605913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:29.612711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaef63-504e-4536-a512-689a4e6b74b9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:29.613296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaef63-504e-4536-a512-689a4e6b74b9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:29.613296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaef63-504e-4536-a512-689a4e6b74b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:29.705499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-46eaef63-504e-4536-a512-689a4e6b74b9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:29.706795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-46eaef63-504e-4536-a512-689a4e6b74b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:29.812419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:29.966320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38ce9-ea03-49e9-b09a-33636c4696be None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:29.968192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f1d38ce9-ea03-49e9-b09a-33636c4696be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:30.026830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:30.127967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d38ce9-ea03-49e9-b09a-33636c4696be None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:30.240602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31397515-7a32-46ce-8147-8a8898ef1cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:30.241205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397515-7a32-46ce-8147-8a8898ef1cce service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:30.241483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397515-7a32-46ce-8147-8a8898ef1cce service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:30.241756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31397515-7a32-46ce-8147-8a8898ef1cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:30.243396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-31397515-7a32-46ce-8147-8a8898ef1cce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:30.250384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:30.337505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31397515-7a32-46ce-8147-8a8898ef1cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:30.339169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31397515-7a32-46ce-8147-8a8898ef1cce service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:30.357495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 709/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:31.169505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d6fd-ba0f-4dbc-bbe2-d0ef18acb902 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:31.170104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d6fd-ba0f-4dbc-bbe2-d0ef18acb902 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:31.170104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d6fd-ba0f-4dbc-bbe2-d0ef18acb902 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:31.171424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:31.177034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895c626-69bf-456d-a3bf-38d8ce4c9e6e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:31.177479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895c626-69bf-456d-a3bf-38d8ce4c9e6e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:31.177583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895c626-69bf-456d-a3bf-38d8ce4c9e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:31.255771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c895c626-69bf-456d-a3bf-38d8ce4c9e6e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:31.257022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c895c626-69bf-456d-a3bf-38d8ce4c9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:31.327807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:31.357423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:31.508229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258d6fd-ba0f-4dbc-bbe2-d0ef18acb902 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:31.509820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9258d6fd-ba0f-4dbc-bbe2-d0ef18acb902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:31.527634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:31.666923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258d6fd-ba0f-4dbc-bbe2-d0ef18acb902 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:31.759816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:31.787751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f98bd2-52bf-42d3-a64b-83afa785b012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:31.788592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f98bd2-52bf-42d3-a64b-83afa785b012 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:31.788888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f98bd2-52bf-42d3-a64b-83afa785b012 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:31.789237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f98bd2-52bf-42d3-a64b-83afa785b012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:31.792116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-35f98bd2-52bf-42d3-a64b-83afa785b012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:31.882410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f98bd2-52bf-42d3-a64b-83afa785b012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:31.884003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f98bd2-52bf-42d3-a64b-83afa785b012 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:31.902503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 724/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:32.723735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e528-4506-4925-8d4f-3e1fbd3165a8 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:32.724269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e528-4506-4925-8d4f-3e1fbd3165a8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:32.724269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e528-4506-4925-8d4f-3e1fbd3165a8 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:32.725546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:32.730832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd4f5-7406-4147-a841-9fc269d19ef6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:32.731312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd4f5-7406-4147-a841-9fc269d19ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:32.731425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd4f5-7406-4147-a841-9fc269d19ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:32.809698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-852fd4f5-7406-4147-a841-9fc269d19ef6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:32.810960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-852fd4f5-7406-4147-a841-9fc269d19ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:32.853482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:32.909584 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:33.058194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e528-4506-4925-8d4f-3e1fbd3165a8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:33.059789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9f99e528-4506-4925-8d4f-3e1fbd3165a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:33.207567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e528-4506-4925-8d4f-3e1fbd3165a8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:33.263961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:33.328802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b7c78-f32d-42d1-a0fc-dd7ac04e2e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:33.329413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b7c78-f32d-42d1-a0fc-dd7ac04e2e69 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:33.329697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b7c78-f32d-42d1-a0fc-dd7ac04e2e69 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:33.329980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b7c78-f32d-42d1-a0fc-dd7ac04e2e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:33.331622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b74b7c78-f32d-42d1-a0fc-dd7ac04e2e69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:33.421539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b7c78-f32d-42d1-a0fc-dd7ac04e2e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:33.423700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b7c78-f32d-42d1-a0fc-dd7ac04e2e69 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:33.442921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 712/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:34.258355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8acab-1520-484d-b478-43e4c19a4f5b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:34.258935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8acab-1520-484d-b478-43e4c19a4f5b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:34.258935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8acab-1520-484d-b478-43e4c19a4f5b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:34.260294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:34.265364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ae6d-5456-4dbe-ab12-55ce1e2814c6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:34.266346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ae6d-5456-4dbe-ab12-55ce1e2814c6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:34.266474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95ae6d-5456-4dbe-ab12-55ce1e2814c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:34.343584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6a95ae6d-5456-4dbe-ab12-55ce1e2814c6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:34.345364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6a95ae6d-5456-4dbe-ab12-55ce1e2814c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:34.347482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:34.444399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:34.596477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8acab-1520-484d-b478-43e4c19a4f5b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:34.599291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-40a8acab-1520-484d-b478-43e4c19a4f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:34.754727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8acab-1520-484d-b478-43e4c19a4f5b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:34.781936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:34.877792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a052370-0a85-4e1d-a618-1917284c850d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:34.878371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a052370-0a85-4e1d-a618-1917284c850d service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:34.878705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a052370-0a85-4e1d-a618-1917284c850d service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:34.879030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a052370-0a85-4e1d-a618-1917284c850d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:34.880701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a052370-0a85-4e1d-a618-1917284c850d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:34.973278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a052370-0a85-4e1d-a618-1917284c850d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:34.974916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a052370-0a85-4e1d-a618-1917284c850d service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:34.995169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 727/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:36.846667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aabebd-2c87-45fb-a78c-77ee088d06c3 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:36.847242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aabebd-2c87-45fb-a78c-77ee088d06c3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:36.847242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aabebd-2c87-45fb-a78c-77ee088d06c3 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:36.848570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:36.853950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a98e4-c76c-4932-94dc-a09111f743ea None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:36.854447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a98e4-c76c-4932-94dc-a09111f743ea None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:36.854541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a98e4-c76c-4932-94dc-a09111f743ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:36.896177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:36.924001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-811a98e4-c76c-4932-94dc-a09111f743ea None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:36.925282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-811a98e4-c76c-4932-94dc-a09111f743ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:37.030597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:37.321099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aabebd-2c87-45fb-a78c-77ee088d06c3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:37.322830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-28aabebd-2c87-45fb-a78c-77ee088d06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:37.427156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aabebd-2c87-45fb-a78c-77ee088d06c3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:37.460133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:37.503630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca270ee-3603-43fb-9592-2d6bdf22d7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:37.504235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca270ee-3603-43fb-9592-2d6bdf22d7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:37.504515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca270ee-3603-43fb-9592-2d6bdf22d7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:37.504788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca270ee-3603-43fb-9592-2d6bdf22d7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:37.506505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-eca270ee-3603-43fb-9592-2d6bdf22d7e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:37.618102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca270ee-3603-43fb-9592-2d6bdf22d7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:37.619474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca270ee-3603-43fb-9592-2d6bdf22d7e1 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:37.637264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 715/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:39.798779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27deff-aab5-41c6-8b2c-5b9c372b7778 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:39.799353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27deff-aab5-41c6-8b2c-5b9c372b7778 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:39.799353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27deff-aab5-41c6-8b2c-5b9c372b7778 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:39.800732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:39.806156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe0e3-4355-457b-a6eb-140a87511608 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:39.806585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe0e3-4355-457b-a6eb-140a87511608 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:39.806748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe0e3-4355-457b-a6eb-140a87511608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:39.874487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-dfafe0e3-4355-457b-a6eb-140a87511608 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:39.876313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dfafe0e3-4355-457b-a6eb-140a87511608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:39.889271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:39.976465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:40.262234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27deff-aab5-41c6-8b2c-5b9c372b7778 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:40.263821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-da27deff-aab5-41c6-8b2c-5b9c372b7778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:40.368329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27deff-aab5-41c6-8b2c-5b9c372b7778 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:40.381040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:40.444361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b97e5-add9-442f-a887-988ef6cc1a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:40.444967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b97e5-add9-442f-a887-988ef6cc1a5e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:40.445244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b97e5-add9-442f-a887-988ef6cc1a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:40.445512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b97e5-add9-442f-a887-988ef6cc1a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:40.447132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-801b97e5-add9-442f-a887-988ef6cc1a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:40.563275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b97e5-add9-442f-a887-988ef6cc1a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:40.564735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b97e5-add9-442f-a887-988ef6cc1a5e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:40.583842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 730/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:42.866636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f819-eb89-4a3b-bcb8-31956804bb9f None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:42.867188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f819-eb89-4a3b-bcb8-31956804bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:42.867188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f819-eb89-4a3b-bcb8-31956804bb9f None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:42.868528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:42.874214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce607185-6f6f-4957-8a69-7289f4c33ae4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:42.874741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce607185-6f6f-4957-8a69-7289f4c33ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:42.874837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce607185-6f6f-4957-8a69-7289f4c33ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:42.929871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:42.954181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ce607185-6f6f-4957-8a69-7289f4c33ae4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:42.956378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ce607185-6f6f-4957-8a69-7289f4c33ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:43.080162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:43.387579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f819-eb89-4a3b-bcb8-31956804bb9f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:43.389110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2b23f819-eb89-4a3b-bcb8-31956804bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:43.498799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f819-eb89-4a3b-bcb8-31956804bb9f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:43.543113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:43.588619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d3d76-9bec-4d0f-a7dd-e7d9dc27c465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:43.589289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d3d76-9bec-4d0f-a7dd-e7d9dc27c465 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:43.589602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d3d76-9bec-4d0f-a7dd-e7d9dc27c465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:43.589909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d3d76-9bec-4d0f-a7dd-e7d9dc27c465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:43.591622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-650d3d76-9bec-4d0f-a7dd-e7d9dc27c465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:43.705076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d3d76-9bec-4d0f-a7dd-e7d9dc27c465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:43.706914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d3d76-9bec-4d0f-a7dd-e7d9dc27c465 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:43.725403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 718/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:45.798630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e576d4-588c-47df-8e18-4191a6469552 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:45.799176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e576d4-588c-47df-8e18-4191a6469552 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:45.799261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e576d4-588c-47df-8e18-4191a6469552 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:45.800613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:09:45.806554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131b6d-dc69-4e93-a582-771eb2d6be79 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:45.807035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131b6d-dc69-4e93-a582-771eb2d6be79 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:45.807142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131b6d-dc69-4e93-a582-771eb2d6be79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:45.876099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5a131b6d-dc69-4e93-a582-771eb2d6be79 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:45.877304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5a131b6d-dc69-4e93-a582-771eb2d6be79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:45.897787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:45.975767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:46.267786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e576d4-588c-47df-8e18-4191a6469552 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:46.269355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-81e576d4-588c-47df-8e18-4191a6469552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:46.389115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e576d4-588c-47df-8e18-4191a6469552 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:46.413306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:46.476483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91611ec-ca4d-4e0e-9a9f-e0b9e909d643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:46.477105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91611ec-ca4d-4e0e-9a9f-e0b9e909d643 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:46.477388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91611ec-ca4d-4e0e-9a9f-e0b9e909d643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:46.477661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91611ec-ca4d-4e0e-9a9f-e0b9e909d643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:46.479373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d91611ec-ca4d-4e0e-9a9f-e0b9e909d643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:46.603711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91611ec-ca4d-4e0e-9a9f-e0b9e909d643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:46.605180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91611ec-ca4d-4e0e-9a9f-e0b9e909d643 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:46.626320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 733/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:48.599172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008173dc-72e4-4631-a9d3-b93ba42f1906 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:48.599743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008173dc-72e4-4631-a9d3-b93ba42f1906 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:48.599743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008173dc-72e4-4631-a9d3-b93ba42f1906 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:48.602376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:48.607059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543693-a775-44a9-a94f-823112909f69 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:48.607576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543693-a775-44a9-a94f-823112909f69 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:48.607671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543693-a775-44a9-a94f-823112909f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:48.673047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:48.676213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1f543693-a775-44a9-a94f-823112909f69 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:48.677992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1f543693-a775-44a9-a94f-823112909f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:48.773168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:09:49.060490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008173dc-72e4-4631-a9d3-b93ba42f1906 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:49.062646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-008173dc-72e4-4631-a9d3-b93ba42f1906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:49.168565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008173dc-72e4-4631-a9d3-b93ba42f1906 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:49.220479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:49.247697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5b9e9-05f6-42b1-a475-635cc528fe4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:49.248316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b9e9-05f6-42b1-a475-635cc528fe4e service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:49.248603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b9e9-05f6-42b1-a475-635cc528fe4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:49.248878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b9e9-05f6-42b1-a475-635cc528fe4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:49.251552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-06b5b9e9-05f6-42b1-a475-635cc528fe4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:49.374220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5b9e9-05f6-42b1-a475-635cc528fe4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:49.376255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5b9e9-05f6-42b1-a475-635cc528fe4e service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:49.396781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 721/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:51.386407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821c06-c1b5-4aa3-a5a3-6f7b9652bb42 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:51.386986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821c06-c1b5-4aa3-a5a3-6f7b9652bb42 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:51.386986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821c06-c1b5-4aa3-a5a3-6f7b9652bb42 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:51.388300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:51.393934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d749832-4a97-4c86-b8cc-09d1bc62f002 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:51.394410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d749832-4a97-4c86-b8cc-09d1bc62f002 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:51.394515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d749832-4a97-4c86-b8cc-09d1bc62f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:51.462985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5d749832-4a97-4c86-b8cc-09d1bc62f002 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:51.464191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5d749832-4a97-4c86-b8cc-09d1bc62f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:51.500435 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:51.571762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:51.863780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f821c06-c1b5-4aa3-a5a3-6f7b9652bb42 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:51.865316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5f821c06-c1b5-4aa3-a5a3-6f7b9652bb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:51.970833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f821c06-c1b5-4aa3-a5a3-6f7b9652bb42 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:52.000619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:52.045190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82116b9-57a8-4b5a-9dd8-90b1c01bb4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:52.045801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82116b9-57a8-4b5a-9dd8-90b1c01bb4ea service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:52.046623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82116b9-57a8-4b5a-9dd8-90b1c01bb4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:52.046917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82116b9-57a8-4b5a-9dd8-90b1c01bb4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:52.048515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d82116b9-57a8-4b5a-9dd8-90b1c01bb4ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:52.162041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82116b9-57a8-4b5a-9dd8-90b1c01bb4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:52.163503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82116b9-57a8-4b5a-9dd8-90b1c01bb4ea service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:52.181963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 736/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:54.225811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba080b-3617-4812-855e-06a57f44760d None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:54.226375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba080b-3617-4812-855e-06a57f44760d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:54.226375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba080b-3617-4812-855e-06a57f44760d None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:54.227750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:54.233270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef721aa-e653-4d5b-beff-8eccdce03085 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:54.233750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef721aa-e653-4d5b-beff-8eccdce03085 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:54.233942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef721aa-e653-4d5b-beff-8eccdce03085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:54.301059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4ef721aa-e653-4d5b-beff-8eccdce03085 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:54.302352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4ef721aa-e653-4d5b-beff-8eccdce03085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:54.310882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:54.406921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:54.692509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba080b-3617-4812-855e-06a57f44760d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:54.694110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-abba080b-3617-4812-855e-06a57f44760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:54.812684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba080b-3617-4812-855e-06a57f44760d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:54.871697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:54.900752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d25862-d128-4998-8940-49cc3fb1ead9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:54.901407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d25862-d128-4998-8940-49cc3fb1ead9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:54.901692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d25862-d128-4998-8940-49cc3fb1ead9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:54.901967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d25862-d128-4998-8940-49cc3fb1ead9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:54.903633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-73d25862-d128-4998-8940-49cc3fb1ead9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:55.017452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d25862-d128-4998-8940-49cc3fb1ead9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:55.018846 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d25862-d128-4998-8940-49cc3fb1ead9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:55.037001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 724/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:57.045466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db74f-c970-4fdf-92cd-af50e852528b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:57.046172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db74f-c970-4fdf-92cd-af50e852528b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:57.046172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db74f-c970-4fdf-92cd-af50e852528b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:57.047440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:57.052740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d198-4767-4150-b0ed-e7da9bd5223d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:57.053194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d198-4767-4150-b0ed-e7da9bd5223d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:57.053307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d198-4767-4150-b0ed-e7da9bd5223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:57.123018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0d89d198-4767-4150-b0ed-e7da9bd5223d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:57.124933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0d89d198-4767-4150-b0ed-e7da9bd5223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:57.163845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:57.223616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:57.513017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4db74f-c970-4fdf-92cd-af50e852528b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:57.515135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ca4db74f-c970-4fdf-92cd-af50e852528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:57.624192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4db74f-c970-4fdf-92cd-af50e852528b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:57.665011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:57.702749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8769f-79cb-4832-882c-3a239571e585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:57.703370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8769f-79cb-4832-882c-3a239571e585 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:57.703649 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8769f-79cb-4832-882c-3a239571e585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:57.703926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8769f-79cb-4832-882c-3a239571e585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:57.705536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1bb8769f-79cb-4832-882c-3a239571e585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:57.817028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8769f-79cb-4832-882c-3a239571e585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:57.818507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8769f-79cb-4832-882c-3a239571e585 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:57.839238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 739/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:59.797706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc3c4-ad2e-48d3-aac9-e5e8997c265b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:59.798367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc3c4-ad2e-48d3-aac9-e5e8997c265b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:59.798367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc3c4-ad2e-48d3-aac9-e5e8997c265b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:59.799723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:09:59.805746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30643cb6-4f74-4494-a137-61ca2ae49711 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:59.806337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30643cb6-4f74-4494-a137-61ca2ae49711 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:59.806337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30643cb6-4f74-4494-a137-61ca2ae49711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:59.873287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-30643cb6-4f74-4494-a137-61ca2ae49711 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:59.875084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-30643cb6-4f74-4494-a137-61ca2ae49711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:59.893882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:59.975312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:00.261340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bc3c4-ad2e-48d3-aac9-e5e8997c265b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:00.262915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-053bc3c4-ad2e-48d3-aac9-e5e8997c265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:00.368592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bc3c4-ad2e-48d3-aac9-e5e8997c265b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:00.434631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:00.442761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5aaf2-75b2-46a3-bede-bd6abf2743d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:00.443371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5aaf2-75b2-46a3-bede-bd6abf2743d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:00.443650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5aaf2-75b2-46a3-bede-bd6abf2743d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:00.443919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5aaf2-75b2-46a3-bede-bd6abf2743d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:00.445502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-39a5aaf2-75b2-46a3-bede-bd6abf2743d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:00.554076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5aaf2-75b2-46a3-bede-bd6abf2743d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:00.555534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5aaf2-75b2-46a3-bede-bd6abf2743d4 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:00.573748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 727/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:02.526102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9789e5-883a-483a-82a0-c62ba5fc0d2d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:02.526709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9789e5-883a-483a-82a0-c62ba5fc0d2d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:02.526709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9789e5-883a-483a-82a0-c62ba5fc0d2d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:02.528053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:02.534127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf584efa-e048-44e0-a4b1-329934e0961d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:02.534585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf584efa-e048-44e0-a4b1-329934e0961d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:02.534714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf584efa-e048-44e0-a4b1-329934e0961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:02.606450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-cf584efa-e048-44e0-a4b1-329934e0961d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:02.607669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cf584efa-e048-44e0-a4b1-329934e0961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:02.657039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:02.705783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:02.989166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9789e5-883a-483a-82a0-c62ba5fc0d2d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:02.990712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1c9789e5-883a-483a-82a0-c62ba5fc0d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:03.095250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9789e5-883a-483a-82a0-c62ba5fc0d2d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:03.143761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:03.170078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef60ca-acd2-44f9-b902-73e956226c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:03.170782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef60ca-acd2-44f9-b902-73e956226c7f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:03.171068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef60ca-acd2-44f9-b902-73e956226c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:03.171339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef60ca-acd2-44f9-b902-73e956226c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:03.172946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-faef60ca-acd2-44f9-b902-73e956226c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:03.284450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef60ca-acd2-44f9-b902-73e956226c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:03.285898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef60ca-acd2-44f9-b902-73e956226c7f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:03.304182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 742/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:12.704076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=22 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:13.301883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=66 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:23.150766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff8ee-993a-45ff-9b6d-3974e612c2bf None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:23.151312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff8ee-993a-45ff-9b6d-3974e612c2bf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:23.151312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eff8ee-993a-45ff-9b6d-3974e612c2bf None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:23.152655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 729/1471] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:23.158857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cd0f0-2ce5-4907-90c3-698013d56c6c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:23.159324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cd0f0-2ce5-4907-90c3-698013d56c6c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:23.159429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cd0f0-2ce5-4907-90c3-698013d56c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:23.226353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-597cd0f0-2ce5-4907-90c3-698013d56c6c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:23.227563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-597cd0f0-2ce5-4907-90c3-698013d56c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:23.323785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 743/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:23.639693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4a99-820c-450b-b1c8-9299d43be97c None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:23.639978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4a99-820c-450b-b1c8-9299d43be97c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:23.640280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4a99-820c-450b-b1c8-9299d43be97c None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:23.641630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 730/1473] 10.222.0.43 () {54 vars in 967 bytes} [Thu Sep 1 08:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:23.646474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe3b0a-a0a4-41b0-b4ba-ca8a11088201 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:23.646769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe3b0a-a0a4-41b0-b4ba-ca8a11088201 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:23.647052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe3b0a-a0a4-41b0-b4ba-ca8a11088201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:23.726396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-77fe3b0a-a0a4-41b0-b4ba-ca8a11088201 None None] MFA Rules not processed for user `d9452756fb5049678dd3aac0d5be651d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:23.727547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-77fe3b0a-a0a4-41b0-b4ba-ca8a11088201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:23.750601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:23.809197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 744/1474] 10.222.0.43 () {58 vars in 1064 bytes} [Thu Sep 1 08:10:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:23.816806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe4a99-820c-450b-b1c8-9299d43be97c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:23.818344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-47fe4a99-820c-450b-b1c8-9299d43be97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:23.926979 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe4a99-820c-450b-b1c8-9299d43be97c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:24.000870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d881b7-a4d2-4c08-95c7-6642a45d0217 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9452756fb5049678dd3aac0d5be651d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:24.001386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d881b7-a4d2-4c08-95c7-6642a45d0217 service glance] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:24.001669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d881b7-a4d2-4c08-95c7-6642a45d0217 service glance] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:24.001942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d881b7-a4d2-4c08-95c7-6642a45d0217 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:24.003587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-88d881b7-a4d2-4c08-95c7-6642a45d0217 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:24.060596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:24.116901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d881b7-a4d2-4c08-95c7-6642a45d0217 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:24.118354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d881b7-a4d2-4c08-95c7-6642a45d0217 service glance] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:24.137056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 731/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:26.198675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f241c-92a2-4b39-9355-78c475994529 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:26.199320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f241c-92a2-4b39-9355-78c475994529 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:26.199320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f241c-92a2-4b39-9355-78c475994529 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:26.200564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 745/1476] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:26.206019 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7818-8fdb-409f-9d78-daefcdd0f4bc None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:26.206465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7818-8fdb-409f-9d78-daefcdd0f4bc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:26.206617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7818-8fdb-409f-9d78-daefcdd0f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:26.275499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2dfa7818-8fdb-409f-9d78-daefcdd0f4bc None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:26.276633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2dfa7818-8fdb-409f-9d78-daefcdd0f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:26.374844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 732/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:26.657090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f241c-92a2-4b39-9355-78c475994529 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:26.658745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-092f241c-92a2-4b39-9355-78c475994529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:26.787002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f241c-92a2-4b39-9355-78c475994529 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:26.837700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:26.885885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ab687-41ce-44cf-ad8f-63c3ef8306c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:26.886525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ab687-41ce-44cf-ad8f-63c3ef8306c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:26.886810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ab687-41ce-44cf-ad8f-63c3ef8306c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:26.887086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ab687-41ce-44cf-ad8f-63c3ef8306c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:26.887735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ab687-41ce-44cf-ad8f-63c3ef8306c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:26.890243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING py.warnings [None req-7d5ab687-41ce-44cf-ad8f-63c3ef8306c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:10:26.890243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: warnings.warn(msg) Sep 01 08:10:26.890243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: Sep 01 08:10:26.891324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ab687-41ce-44cf-ad8f-63c3ef8306c4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:26.911927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 746/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 08:10:26 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:10:28.960838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14980a-efad-4b87-b5eb-d95822b591e0 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:28.961468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14980a-efad-4b87-b5eb-d95822b591e0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:28.961677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14980a-efad-4b87-b5eb-d95822b591e0 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:28.963138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 733/1479] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:10:28.971791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85a0a-8c78-4f81-9a41-22eb083976a4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:28.971791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85a0a-8c78-4f81-9a41-22eb083976a4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:28.971791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85a0a-8c78-4f81-9a41-22eb083976a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:29.060708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-71d85a0a-8c78-4f81-9a41-22eb083976a4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:29.062021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-71d85a0a-8c78-4f81-9a41-22eb083976a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:29.174376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 747/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:29.470407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14980a-efad-4b87-b5eb-d95822b591e0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:29.471945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0f14980a-efad-4b87-b5eb-d95822b591e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:29.482858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:29.662952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14980a-efad-4b87-b5eb-d95822b591e0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:29.766305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:29.813402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d25fdb-d47c-4b21-9868-3f9d81adbbe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:29.814022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25fdb-d47c-4b21-9868-3f9d81adbbe3 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:29.814324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25fdb-d47c-4b21-9868-3f9d81adbbe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:29.814598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25fdb-d47c-4b21-9868-3f9d81adbbe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:29.816245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-86d25fdb-d47c-4b21-9868-3f9d81adbbe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:29.916190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d25fdb-d47c-4b21-9868-3f9d81adbbe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:29.917862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d25fdb-d47c-4b21-9868-3f9d81adbbe3 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:29.937871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 734/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:32.105884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c38c1-1c5f-4943-9b51-bc32858a96b0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:32.106491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c38c1-1c5f-4943-9b51-bc32858a96b0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:32.106491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c38c1-1c5f-4943-9b51-bc32858a96b0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:32.107867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 748/1482] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:32.113484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0f6f-e8b0-4e10-ad9b-addbe6aaec1e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:32.113934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0f6f-e8b0-4e10-ad9b-addbe6aaec1e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:32.114038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0f6f-e8b0-4e10-ad9b-addbe6aaec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:32.181570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ffea0f6f-e8b0-4e10-ad9b-addbe6aaec1e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:32.182823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ffea0f6f-e8b0-4e10-ad9b-addbe6aaec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:32.241438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:32.298638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 735/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:32.584847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c38c1-1c5f-4943-9b51-bc32858a96b0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:32.586428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-735c38c1-1c5f-4943-9b51-bc32858a96b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:32.616075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:32.697682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c38c1-1c5f-4943-9b51-bc32858a96b0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:32.772318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41992b93-a4f7-4c3e-9b17-3625200739e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:32.772841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992b93-a4f7-4c3e-9b17-3625200739e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:32.773128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992b93-a4f7-4c3e-9b17-3625200739e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:32.773394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992b93-a4f7-4c3e-9b17-3625200739e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:32.775019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-41992b93-a4f7-4c3e-9b17-3625200739e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:32.852961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:32.890514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41992b93-a4f7-4c3e-9b17-3625200739e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:32.892359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41992b93-a4f7-4c3e-9b17-3625200739e0 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:32.912824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 749/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:34.948353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d827-39d4-433c-8b71-3629954a9637 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:34.948959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d827-39d4-433c-8b71-3629954a9637 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:34.948959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d827-39d4-433c-8b71-3629954a9637 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:34.950313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 736/1485] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:34.957143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396579c-d6b4-45b8-b674-5640792fdb8c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:34.957640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396579c-d6b4-45b8-b674-5640792fdb8c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:34.957765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396579c-d6b4-45b8-b674-5640792fdb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:35.023623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f396579c-d6b4-45b8-b674-5640792fdb8c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:35.024840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f396579c-d6b4-45b8-b674-5640792fdb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:35.120660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 750/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:10:35.412887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348d827-39d4-433c-8b71-3629954a9637 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:35.414473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8348d827-39d4-433c-8b71-3629954a9637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:35.519295 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348d827-39d4-433c-8b71-3629954a9637 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:35.591283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:35.593063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54520-f545-43de-b7e6-2cfa3ff6e258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:35.593724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54520-f545-43de-b7e6-2cfa3ff6e258 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:35.594030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54520-f545-43de-b7e6-2cfa3ff6e258 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:35.594312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54520-f545-43de-b7e6-2cfa3ff6e258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:35.596350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-96a54520-f545-43de-b7e6-2cfa3ff6e258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:35.711596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54520-f545-43de-b7e6-2cfa3ff6e258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:35.713041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54520-f545-43de-b7e6-2cfa3ff6e258 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:35.731065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 737/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:37.760716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6273b6-bed0-483c-99ca-94c869caa016 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:37.761244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6273b6-bed0-483c-99ca-94c869caa016 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:37.761244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6273b6-bed0-483c-99ca-94c869caa016 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:37.762589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 751/1488] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:37.768077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18865-1d74-42d8-89e5-26239753de05 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:37.768611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18865-1d74-42d8-89e5-26239753de05 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:37.768611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18865-1d74-42d8-89e5-26239753de05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:37.835095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-87d18865-1d74-42d8-89e5-26239753de05 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:37.836328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-87d18865-1d74-42d8-89e5-26239753de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:37.889407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:37.932869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 738/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:38.239555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6273b6-bed0-483c-99ca-94c869caa016 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:38.241236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6d6273b6-bed0-483c-99ca-94c869caa016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:38.280264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:38.351544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6273b6-bed0-483c-99ca-94c869caa016 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:38.430722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285a2c8-a3d7-4cb2-8440-6991b637e815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:38.431330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285a2c8-a3d7-4cb2-8440-6991b637e815 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:38.431608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285a2c8-a3d7-4cb2-8440-6991b637e815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:38.431878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285a2c8-a3d7-4cb2-8440-6991b637e815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:38.433491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9285a2c8-a3d7-4cb2-8440-6991b637e815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:38.518832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:38.548644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285a2c8-a3d7-4cb2-8440-6991b637e815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:38.550093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285a2c8-a3d7-4cb2-8440-6991b637e815 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:38.569197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 752/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:10:40.811316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761fb73-1cbb-421a-9d47-0f4666560224 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:40.811884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761fb73-1cbb-421a-9d47-0f4666560224 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:40.811884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761fb73-1cbb-421a-9d47-0f4666560224 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:40.813230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 739/1491] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 08:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:40.818722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895a07-6142-4dfb-bb78-ff33cc616881 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:40.819165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895a07-6142-4dfb-bb78-ff33cc616881 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:40.819313 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9895a07-6142-4dfb-bb78-ff33cc616881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:40.888437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d9895a07-6142-4dfb-bb78-ff33cc616881 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:40.889803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d9895a07-6142-4dfb-bb78-ff33cc616881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:40.991272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 753/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:41.284463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761fb73-1cbb-421a-9d47-0f4666560224 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:41.286038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a761fb73-1cbb-421a-9d47-0f4666560224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:41.410456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761fb73-1cbb-421a-9d47-0f4666560224 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:41.488211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba0549-1073-4680-87be-adf73317e341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:41.489178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba0549-1073-4680-87be-adf73317e341 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:41.489465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba0549-1073-4680-87be-adf73317e341 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:41.489738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba0549-1073-4680-87be-adf73317e341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:41.491465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3fba0549-1073-4680-87be-adf73317e341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:41.501557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:41.607018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba0549-1073-4680-87be-adf73317e341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:41.608808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba0549-1073-4680-87be-adf73317e341 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:41.627138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 740/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:50.989659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=82 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:51.624845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=50 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:15.044035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780e111-d623-4218-ad4b-327af86d12db None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:15.044637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780e111-d623-4218-ad4b-327af86d12db None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:15.044637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780e111-d623-4218-ad4b-327af86d12db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:15.123394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2780e111-d623-4218-ad4b-327af86d12db None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:12:15.124619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2780e111-d623-4218-ad4b-327af86d12db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:15.220540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 754/1494] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:12:15.228841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6948-7fc7-46a7-88f2-51c9a9b3eed6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:15.229354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6948-7fc7-46a7-88f2-51c9a9b3eed6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:15.229466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6948-7fc7-46a7-88f2-51c9a9b3eed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:15.308468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e65c6948-7fc7-46a7-88f2-51c9a9b3eed6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:12:15.309607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e65c6948-7fc7-46a7-88f2-51c9a9b3eed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:15.410229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 741/1495] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:12:15.414970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780e111-d623-4218-ad4b-327af86d12db None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:15.416418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2780e111-d623-4218-ad4b-327af86d12db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:15.427662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780e111-d623-4218-ad4b-327af86d12db None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:15.490820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:15.527790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:15.528400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:15.528680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:15.528955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:15.529596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:12:15.529902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:15.530941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING py.warnings [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:12:15.530941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: warnings.warn(msg) Sep 01 08:12:15.530941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: Sep 01 08:12:15.531826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:15.542791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 755/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:12:15.551263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6948-7fc7-46a7-88f2-51c9a9b3eed6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:15.560998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6948-7fc7-46a7-88f2-51c9a9b3eed6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:15.624835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:15.659151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:15.659757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:15.660039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:15.660310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:15.660935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:15.662770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING py.warnings [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:12:15.662770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: warnings.warn(msg) Sep 01 08:12:15.662770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: Sep 01 08:12:15.663967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:15.720004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 742/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:12:15 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:12:15.724722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:15.726245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:15.759991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d69a4-ea77-4606-9c25-af6bc828d319 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:15.856401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:15.856907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:15.857187 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:15.857461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:15.858078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:15.859123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING py.warnings [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:12:15.859123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: warnings.warn(msg) Sep 01 08:12:15.859123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: Sep 01 08:12:15.860326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:15.902453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 756/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:12:15 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:12:15.906775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:15.908304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:15.969635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20658aae-504d-457c-ac57-a58ac4282ef8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:16.053087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:16.064724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:16.065336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:16.065644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:16.065916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:16.066579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:16.067579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING py.warnings [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:12:16.067579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: warnings.warn(msg) Sep 01 08:12:16.067579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: Sep 01 08:12:16.068494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:16.082000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 743/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:12:16.086300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:16.088595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:16.100031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc1e6-ead0-496f-a912-95911d2d20d6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:16.127665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:16.210140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226388ec-b47f-4520-8dcb-da817ba346fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:16.210791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226388ec-b47f-4520-8dcb-da817ba346fb admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:16.211069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226388ec-b47f-4520-8dcb-da817ba346fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:16.211338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226388ec-b47f-4520-8dcb-da817ba346fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:16.211996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226388ec-b47f-4520-8dcb-da817ba346fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:16.213724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING py.warnings [None req-226388ec-b47f-4520-8dcb-da817ba346fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:12:16.213724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: warnings.warn(msg) Sep 01 08:12:16.213724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: Sep 01 08:12:16.214700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226388ec-b47f-4520-8dcb-da817ba346fb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:16.228789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 757/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:12:16.233529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:16.235102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:16.271080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b971ef-a2f9-4431-9701-ea2b8d8cebe2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:16.365047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccb53b-11f3-4fe4-a9a6-dc904693615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:16.365768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccb53b-11f3-4fe4-a9a6-dc904693615b admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:16.366085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccb53b-11f3-4fe4-a9a6-dc904693615b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:16.366425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccb53b-11f3-4fe4-a9a6-dc904693615b admin admin] PATH_INFO: `/v3/projects/efb961ac773e4c6c89b2976b5d9cd276/users/a536027a8e8240d3a8c55c22f3d53101/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:16.392039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccb53b-11f3-4fe4-a9a6-dc904693615b admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb961ac773e4c6c89b2976b5d9cd276, user_id=a536027a8e8240d3a8c55c22f3d53101, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:16.393032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING py.warnings [None req-8dccb53b-11f3-4fe4-a9a6-dc904693615b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:12:16.393032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: warnings.warn(msg) Sep 01 08:12:16.393032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: Sep 01 08:12:16.395029 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccb53b-11f3-4fe4-a9a6-dc904693615b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:16.419294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 744/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:12:16 2022] PUT /identity/v3/projects/efb961ac773e4c6c89b2976b5d9cd276/users/a536027a8e8240d3a8c55c22f3d53101/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:12:16.431785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0766d-179c-426e-aae9-bf8310ba058c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:16.432069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0766d-179c-426e-aae9-bf8310ba058c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:16.432427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0766d-179c-426e-aae9-bf8310ba058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:16.490887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0df0766d-179c-426e-aae9-bf8310ba058c None None] MFA Rules not processed for user `a536027a8e8240d3a8c55c22f3d53101`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:12:16.492089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0df0766d-179c-426e-aae9-bf8310ba058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:16.569199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 758/1502] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:12:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:12:16.583096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f23df9-c988-41fc-a7ee-f9fb97b0ba98 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:16.583425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f23df9-c988-41fc-a7ee-f9fb97b0ba98 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:16.583737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f23df9-c988-41fc-a7ee-f9fb97b0ba98 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:16.585112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 745/1503] 10.222.0.43 () {54 vars in 964 bytes} [Thu Sep 1 08:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:12:16.590187 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036a95-7a85-4d65-b586-5ee69cc8407e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:16.590547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036a95-7a85-4d65-b586-5ee69cc8407e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:16.590814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036a95-7a85-4d65-b586-5ee69cc8407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:16.622152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:16.675711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ce036a95-7a85-4d65-b586-5ee69cc8407e None None] MFA Rules not processed for user `8c37ab868df74cd5a36323f7db5699d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:12:16.676835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ce036a95-7a85-4d65-b586-5ee69cc8407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:16.752601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 759/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Sep 1 08:12:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:12:16.760666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f23df9-c988-41fc-a7ee-f9fb97b0ba98 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:16.762248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-04f23df9-c988-41fc-a7ee-f9fb97b0ba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:16.814274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:16.869596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f23df9-c988-41fc-a7ee-f9fb97b0ba98 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:16.944406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:16.944919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:16.945195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:16.945457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:16.947114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:17.045824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:17.047287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:17.050743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:17.066005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 746/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:12:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:12:17.112117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ab4b-ef9d-4e8d-a7c4-2fd19b02f71a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:17.112567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ab4b-ef9d-4e8d-a7c4-2fd19b02f71a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:17.112649 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ab4b-ef9d-4e8d-a7c4-2fd19b02f71a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:17.113900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 760/1506] 10.222.0.43 () {52 vars in 830 bytes} [Thu Sep 1 08:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:12:17.117460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:17.119362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:17.222574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec985e0b-b8f0-4635-ae8d-8b5259f0e528 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:17.438763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:17.439431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:17.439671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:17.439946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] PATH_INFO: `/v3/users/a536027a8e8240d3a8c55c22f3d53101` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:17.454073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a536027a8e8240d3a8c55c22f3d53101)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:17.455145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING py.warnings [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:12:17.455145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: warnings.warn(msg) Sep 01 08:12:17.455145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: Sep 01 08:12:17.456361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:17.467786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:17.528273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a536027a8e8240d3a8c55c22f3d53101'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:17.542059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a536027a8e8240d3a8c55c22f3d53101'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:17.542689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a536027a8e8240d3a8c55c22f3d53101'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:17.552250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a536027a8e8240d3a8c55c22f3d53101'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:17.575635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a536027a8e8240d3a8c55c22f3d53101'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:17.581137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 747/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:12:17 2022] DELETE /identity/v3/users/a536027a8e8240d3a8c55c22f3d53101 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:12:17.585656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d38c-7bd1-4503-a9d1-48859c52bc09 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:17.585943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d38c-7bd1-4503-a9d1-48859c52bc09 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:17.586221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d38c-7bd1-4503-a9d1-48859c52bc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:17.643261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0e76d38c-7bd1-4503-a9d1-48859c52bc09 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:12:17.644515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0e76d38c-7bd1-4503-a9d1-48859c52bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:17.719001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:17.732909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 761/1508] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:12:17.742472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:17.744442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:17.845707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3d427-1bb6-463e-8daa-161748693e38 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:17.901663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:17.922578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92eef6c-d17d-4387-be44-9319bc7b9435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:17.923191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eef6c-d17d-4387-be44-9319bc7b9435 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:17.923472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eef6c-d17d-4387-be44-9319bc7b9435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:17.923748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eef6c-d17d-4387-be44-9319bc7b9435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:17.925351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c92eef6c-d17d-4387-be44-9319bc7b9435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:18.035850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92eef6c-d17d-4387-be44-9319bc7b9435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:18.037300 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92eef6c-d17d-4387-be44-9319bc7b9435 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:18.055516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 748/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:12:18.413934 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76d38c-7bd1-4503-a9d1-48859c52bc09 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:12:18.415248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0e76d38c-7bd1-4503-a9d1-48859c52bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:12:18.427344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76d38c-7bd1-4503-a9d1-48859c52bc09 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:12:18.527774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:12:18.528395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:12:18.528676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:12:18.528955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] PATH_INFO: `/v3/projects/efb961ac773e4c6c89b2976b5d9cd276` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:12:18.538873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb961ac773e4c6c89b2976b5d9cd276)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:12:18.539896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING py.warnings [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:12:18.539896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: warnings.warn(msg) Sep 01 08:12:18.539896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: Sep 01 08:12:18.541117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:12:18.598736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb961ac773e4c6c89b2976b5d9cd276', 'request_id': 'req-3631cd8c-efa8-440f-b04c-8cd857153b7c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:18.612031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb961ac773e4c6c89b2976b5d9cd276', 'request_id': 'req-3631cd8c-efa8-440f-b04c-8cd857153b7c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:18.618080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb961ac773e4c6c89b2976b5d9cd276', 'request_id': 'req-3631cd8c-efa8-440f-b04c-8cd857153b7c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:18.644705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] The token cache is being invalidate because project efb961ac773e4c6c89b2976b5d9cd276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:12:18.644999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:18.645432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3631cd8c-efa8-440f-b04c-8cd857153b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:12:18.646872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 762/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:12:18 2022] DELETE /identity/v3/projects/efb961ac773e4c6c89b2976b5d9cd276 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:12:28.053200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=62 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:28.642642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:46.912659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b28ce-b574-4728-911a-8adbb6714f95 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:46.913268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b28ce-b574-4728-911a-8adbb6714f95 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:46.913268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b28ce-b574-4728-911a-8adbb6714f95 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:46.914626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:46.920182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2113b70-22ba-49ff-bf0f-71df0c016fb2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:46.920624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2113b70-22ba-49ff-bf0f-71df0c016fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:46.920722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2113b70-22ba-49ff-bf0f-71df0c016fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:47.005722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f2113b70-22ba-49ff-bf0f-71df0c016fb2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:47.006967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f2113b70-22ba-49ff-bf0f-71df0c016fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:47.112135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:47.282865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b28ce-b574-4728-911a-8adbb6714f95 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:47.285085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c61b28ce-b574-4728-911a-8adbb6714f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:47.404649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b28ce-b574-4728-911a-8adbb6714f95 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:47.410143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1500-b63e-43f0-8c7c-81ce5884f6ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:47.410722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1500-b63e-43f0-8c7c-81ce5884f6ae service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:47.411003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1500-b63e-43f0-8c7c-81ce5884f6ae service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:47.411279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1500-b63e-43f0-8c7c-81ce5884f6ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:47.422303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d1500-b63e-43f0-8c7c-81ce5884f6ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:47.424044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d1500-b63e-43f0-8c7c-81ce5884f6ae service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:47.435078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 750/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:48.287015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadbd0a-39aa-44d3-862c-a752a6600925 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:48.287926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadbd0a-39aa-44d3-862c-a752a6600925 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:48.288215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadbd0a-39aa-44d3-862c-a752a6600925 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:48.289615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:48.295057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087e047-aacc-4720-bd6b-4f2a18341e43 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:48.295571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087e047-aacc-4720-bd6b-4f2a18341e43 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:48.295685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087e047-aacc-4720-bd6b-4f2a18341e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:48.316206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4087e047-aacc-4720-bd6b-4f2a18341e43 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:48.317397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4087e047-aacc-4720-bd6b-4f2a18341e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:48.325774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:48.329447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0804cd-7d63-4532-a4a5-484ba3b261d9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:48.329737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0804cd-7d63-4532-a4a5-484ba3b261d9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:48.330040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0804cd-7d63-4532-a4a5-484ba3b261d9 None None] PATH_INFO: `/v3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:48.331330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 765/1516] 10.222.0.33 () {54 vars in 925 bytes} [Thu Sep 1 08:13:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:13:48.337521 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f487-b06a-4023-8959-31c6c408eda8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:48.337817 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f487-b06a-4023-8959-31c6c408eda8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:48.338103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f487-b06a-4023-8959-31c6c408eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:48.401291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-96e1f487-b06a-4023-8959-31c6c408eda8 None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:48.402538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-96e1f487-b06a-4023-8959-31c6c408eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:48.457069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:48.477343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 752/1517] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Sep 1 08:13:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:48.482228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0804cd-7d63-4532-a4a5-484ba3b261d9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:48.498127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0804cd-7d63-4532-a4a5-484ba3b261d9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:48.503523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80b8b-688e-4c44-ba70-fca3d458e495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:48.504119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80b8b-688e-4c44-ba70-fca3d458e495 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:48.504397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80b8b-688e-4c44-ba70-fca3d458e495 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:48.504666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80b8b-688e-4c44-ba70-fca3d458e495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:48.512818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b80b8b-688e-4c44-ba70-fca3d458e495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:48.514409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b80b8b-688e-4c44-ba70-fca3d458e495 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:48.523565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 766/1518] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:57.368599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca6b3f-6b47-48ad-b11c-ef6e515495b4 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:57.369150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca6b3f-6b47-48ad-b11c-ef6e515495b4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:57.369245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca6b3f-6b47-48ad-b11c-ef6e515495b4 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:57.370622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 753/1519] 10.222.0.43 () {54 vars in 961 bytes} [Thu Sep 1 08:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:57.375490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb0dd-61da-47d4-a718-bb84233539da None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:57.375943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb0dd-61da-47d4-a718-bb84233539da None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:57.376052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb0dd-61da-47d4-a718-bb84233539da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:57.395106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7a4bb0dd-61da-47d4-a718-bb84233539da None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:57.396285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a4bb0dd-61da-47d4-a718-bb84233539da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:57.405520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 767/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Sep 1 08:13:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:57.413113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca6b3f-6b47-48ad-b11c-ef6e515495b4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:57.426761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca6b3f-6b47-48ad-b11c-ef6e515495b4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:57.431734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e76ca-3a5f-4ee7-a9b5-03d482908120 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:57.432321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e76ca-3a5f-4ee7-a9b5-03d482908120 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:57.432599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e76ca-3a5f-4ee7-a9b5-03d482908120 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:57.432876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e76ca-3a5f-4ee7-a9b5-03d482908120 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:57.441751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e76ca-3a5f-4ee7-a9b5-03d482908120 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:57.443336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e76ca-3a5f-4ee7-a9b5-03d482908120 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:57.453567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 754/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:59.750933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fa29f-74ee-40b3-8527-bba58535327f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:59.751476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fa29f-74ee-40b3-8527-bba58535327f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:59.751476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fa29f-74ee-40b3-8527-bba58535327f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:59.752734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:59.757555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a935cab-0311-41e8-92f1-cb5b30a947ad None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:59.757952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a935cab-0311-41e8-92f1-cb5b30a947ad None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:59.758150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a935cab-0311-41e8-92f1-cb5b30a947ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:59.778283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3a935cab-0311-41e8-92f1-cb5b30a947ad None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:59.779496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a935cab-0311-41e8-92f1-cb5b30a947ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:59.787174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:59.941964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fa29f-74ee-40b3-8527-bba58535327f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:59.957077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fa29f-74ee-40b3-8527-bba58535327f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:59.963287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40148d66-e169-4558-948a-56335b05cb27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:59.963877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40148d66-e169-4558-948a-56335b05cb27 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:59.964155 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40148d66-e169-4558-948a-56335b05cb27 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:59.964427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40148d66-e169-4558-948a-56335b05cb27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:59.972545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40148d66-e169-4558-948a-56335b05cb27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:59.974101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40148d66-e169-4558-948a-56335b05cb27 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:59.983861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 769/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:14:00.817107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354de2-3193-4530-bebd-be406eda6611 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:00.817653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354de2-3193-4530-bebd-be406eda6611 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:00.817653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354de2-3193-4530-bebd-be406eda6611 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:00.819030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:14:00.824363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edf21-49fc-49b6-b850-d0f3c747c78e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:00.824838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edf21-49fc-49b6-b850-d0f3c747c78e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:00.824948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edf21-49fc-49b6-b850-d0f3c747c78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:00.847847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-262edf21-49fc-49b6-b850-d0f3c747c78e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:14:00.849044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-262edf21-49fc-49b6-b850-d0f3c747c78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:14:00.857238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:14:01.017242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354de2-3193-4530-bebd-be406eda6611 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:14:01.031886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354de2-3193-4530-bebd-be406eda6611 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:14:01.037609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d25d5e-5283-4279-a954-ffedd4e1ec89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:14:01.038207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d25d5e-5283-4279-a954-ffedd4e1ec89 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:01.038519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d25d5e-5283-4279-a954-ffedd4e1ec89 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:01.038793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d25d5e-5283-4279-a954-ffedd4e1ec89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:01.047718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d25d5e-5283-4279-a954-ffedd4e1ec89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:14:01.049297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d25d5e-5283-4279-a954-ffedd4e1ec89 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:14:01.059348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 757/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:14:05.062908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2b213-a050-4dd0-bbbc-3852417acafc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:05.063428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2b213-a050-4dd0-bbbc-3852417acafc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:05.063428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2b213-a050-4dd0-bbbc-3852417acafc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:05.064718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:14:05.069797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800877cd-30ee-4136-9c94-730a883a9d0e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:05.070244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800877cd-30ee-4136-9c94-730a883a9d0e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:05.070397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800877cd-30ee-4136-9c94-730a883a9d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:05.089198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-800877cd-30ee-4136-9c94-730a883a9d0e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:14:05.090428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-800877cd-30ee-4136-9c94-730a883a9d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:14:05.098038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:14:05.383937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2b213-a050-4dd0-bbbc-3852417acafc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:14:05.385648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2cc2b213-a050-4dd0-bbbc-3852417acafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:14:05.419374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:14:05.468394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2b213-a050-4dd0-bbbc-3852417acafc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:14:05.471996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37484c71-377d-4d20-acda-1e84d086fc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:14:05.472632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c71-377d-4d20-acda-1e84d086fc48 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:05.472913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c71-377d-4d20-acda-1e84d086fc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:05.473214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484c71-377d-4d20-acda-1e84d086fc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:05.483617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37484c71-377d-4d20-acda-1e84d086fc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:14:05.485468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37484c71-377d-4d20-acda-1e84d086fc48 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:14:05.496234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 772/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:14:07.417427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae61e0-bfe6-48fb-b325-d5896b7ee3e4 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:07.417968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae61e0-bfe6-48fb-b325-d5896b7ee3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:07.417968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae61e0-bfe6-48fb-b325-d5896b7ee3e4 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:07.419263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:14:07.424588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988161b0-9566-4ceb-b8bc-8ea1af539781 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:07.424996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988161b0-9566-4ceb-b8bc-8ea1af539781 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:07.425150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988161b0-9566-4ceb-b8bc-8ea1af539781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:07.445467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-988161b0-9566-4ceb-b8bc-8ea1af539781 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:14:07.447107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-988161b0-9566-4ceb-b8bc-8ea1af539781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:14:07.455431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:14:07.747800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae61e0-bfe6-48fb-b325-d5896b7ee3e4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:14:07.758696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae61e0-bfe6-48fb-b325-d5896b7ee3e4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:14:07.762333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff8f05-f6d3-45ac-90e1-1675873f9f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:14:07.762924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8f05-f6d3-45ac-90e1-1675873f9f22 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:07.763228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8f05-f6d3-45ac-90e1-1675873f9f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:07.763500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8f05-f6d3-45ac-90e1-1675873f9f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:07.772276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8f05-f6d3-45ac-90e1-1675873f9f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:14:07.773679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8f05-f6d3-45ac-90e1-1675873f9f22 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:14:07.784287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 760/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:14:11.289226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a3c1-ba68-4de4-aa29-a4b36265ac10 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:11.289821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a3c1-ba68-4de4-aa29-a4b36265ac10 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:11.289821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a3c1-ba68-4de4-aa29-a4b36265ac10 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:11.291804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:14:11.297127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c95af-1eee-40aa-ba3c-70cf52f465a0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:11.297572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c95af-1eee-40aa-ba3c-70cf52f465a0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:11.297676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c95af-1eee-40aa-ba3c-70cf52f465a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:11.316883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f62c95af-1eee-40aa-ba3c-70cf52f465a0 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:14:11.318076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f62c95af-1eee-40aa-ba3c-70cf52f465a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:14:11.326173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:14:11.886343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54a3c1-ba68-4de4-aa29-a4b36265ac10 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:14:11.887988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3d54a3c1-ba68-4de4-aa29-a4b36265ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:14:11.965140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54a3c1-ba68-4de4-aa29-a4b36265ac10 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:14:11.968666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd8260-1063-43ba-b443-406615acd560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:14:11.969263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8260-1063-43ba-b443-406615acd560 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:11.969542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8260-1063-43ba-b443-406615acd560 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:11.969813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8260-1063-43ba-b443-406615acd560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:11.978761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd8260-1063-43ba-b443-406615acd560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:14:11.980172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd8260-1063-43ba-b443-406615acd560 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:14:11.989237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 775/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:14:14.051168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7440ae-35dc-4b9e-aaf2-5f76b7cf85fa None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:14.051760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7440ae-35dc-4b9e-aaf2-5f76b7cf85fa None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:14.051760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7440ae-35dc-4b9e-aaf2-5f76b7cf85fa None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:14.053049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:14:14.058987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd84dc2-07b5-4f58-a948-de238e9851a5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:14.059423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd84dc2-07b5-4f58-a948-de238e9851a5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:14.059530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd84dc2-07b5-4f58-a948-de238e9851a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:14.080886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0bd84dc2-07b5-4f58-a948-de238e9851a5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:14:14.082127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0bd84dc2-07b5-4f58-a948-de238e9851a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:14:14.090632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:14:14.659117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7440ae-35dc-4b9e-aaf2-5f76b7cf85fa None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:14:14.660922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aa7440ae-35dc-4b9e-aaf2-5f76b7cf85fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:14:14.674292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7440ae-35dc-4b9e-aaf2-5f76b7cf85fa None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:14:14.677877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf89dc-b836-4156-aaf3-c50b0eef4aed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:14:14.678505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf89dc-b836-4156-aaf3-c50b0eef4aed service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:14:14.678787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf89dc-b836-4156-aaf3-c50b0eef4aed service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:14:14.679059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf89dc-b836-4156-aaf3-c50b0eef4aed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:14:14.687798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf89dc-b836-4156-aaf3-c50b0eef4aed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:14:14.689215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf89dc-b836-4156-aaf3-c50b0eef4aed service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:14:14.699054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 763/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:14:24.076294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=63 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:14:24.694386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=37 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:41.976526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f183-9206-4b60-af29-05c9a4485051 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.978559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f183-9206-4b60-af29-05c9a4485051 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.978559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f183-9206-4b60-af29-05c9a4485051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.008205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1458f183-9206-4b60-af29-05c9a4485051 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.009395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1458f183-9206-4b60-af29-05c9a4485051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.028896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 777/1540] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:42.039398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f264-8729-4ad4-a8cf-6b51081b3940 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.040168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f264-8729-4ad4-a8cf-6b51081b3940 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.040168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f264-8729-4ad4-a8cf-6b51081b3940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.071295 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4083f264-8729-4ad4-a8cf-6b51081b3940 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.072591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4083f264-8729-4ad4-a8cf-6b51081b3940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.090036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 764/1541] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:42.095184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f183-9206-4b60-af29-05c9a4485051 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.112551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f183-9206-4b60-af29-05c9a4485051 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.127202 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.127845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.128131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.128390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.129466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:42.129797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.131737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.150761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 778/1542] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:15:42.159592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f264-8729-4ad4-a8cf-6b51081b3940 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.174803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f264-8729-4ad4-a8cf-6b51081b3940 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.182972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2823f2-0c20-4710-9ee5-c3211f90d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.183620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2823f2-0c20-4710-9ee5-c3211f90d8bb admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.183909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2823f2-0c20-4710-9ee5-c3211f90d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.184194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2823f2-0c20-4710-9ee5-c3211f90d8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.184862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2823f2-0c20-4710-9ee5-c3211f90d8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.186928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2823f2-0c20-4710-9ee5-c3211f90d8bb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.253808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 765/1543] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:42.259348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.275600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493379cb-c2ae-472f-98fe-1edbaf2f7f11 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.317040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2dfa-1ab0-4972-8953-66bb6f824111 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.317444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2dfa-1ab0-4972-8953-66bb6f824111 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.317661 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2dfa-1ab0-4972-8953-66bb6f824111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.354749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f3cf2dfa-1ab0-4972-8953-66bb6f824111 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.355934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f3cf2dfa-1ab0-4972-8953-66bb6f824111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.421304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a35bd-cbe4-4992-8ef6-a3cb655aa4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.422521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a35bd-cbe4-4992-8ef6-a3cb655aa4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.423242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a35bd-cbe4-4992-8ef6-a3cb655aa4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.423802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a35bd-cbe4-4992-8ef6-a3cb655aa4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.425079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a35bd-cbe4-4992-8ef6-a3cb655aa4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.428986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a35bd-cbe4-4992-8ef6-a3cb655aa4a4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.510612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 779/1544] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:42.513554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839f16-56fc-4cf6-8147-229096931662 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.518850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839f16-56fc-4cf6-8147-229096931662 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.519840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839f16-56fc-4cf6-8147-229096931662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.523549 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 766/1545] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:42.524571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf2dfa-1ab0-4972-8953-66bb6f824111 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.555164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf2dfa-1ab0-4972-8953-66bb6f824111 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.562534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bdb2d-690f-4b10-90dc-46f572cfd563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.565966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bdb2d-690f-4b10-90dc-46f572cfd563 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.565966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bdb2d-690f-4b10-90dc-46f572cfd563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.565966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bdb2d-690f-4b10-90dc-46f572cfd563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.565966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bdb2d-690f-4b10-90dc-46f572cfd563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.566809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bdb2d-690f-4b10-90dc-46f572cfd563 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.578980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b6839f16-56fc-4cf6-8147-229096931662 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.581582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b6839f16-56fc-4cf6-8147-229096931662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.593717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 767/1546] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:42.595767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81f945-d264-4e5b-8932-798d3e7f273f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.596065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81f945-d264-4e5b-8932-798d3e7f273f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.596354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81f945-d264-4e5b-8932-798d3e7f273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.607033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 780/1547] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:42.608928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6839f16-56fc-4cf6-8147-229096931662 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.636245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ba81f945-d264-4e5b-8932-798d3e7f273f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.637621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ba81f945-d264-4e5b-8932-798d3e7f273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.642853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6839f16-56fc-4cf6-8147-229096931662 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.655452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0db11e-be89-4af4-8873-982538b0197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.656894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0db11e-be89-4af4-8873-982538b0197a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.657726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0db11e-be89-4af4-8873-982538b0197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.663012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0db11e-be89-4af4-8873-982538b0197a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.664203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 768/1548] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:42.664915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0db11e-be89-4af4-8873-982538b0197a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.665688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4ed50-9b99-4333-aea2-48724ac9c915 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.665979 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4ed50-9b99-4333-aea2-48724ac9c915 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.666398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4ed50-9b99-4333-aea2-48724ac9c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.669570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0db11e-be89-4af4-8873-982538b0197a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.703787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-85b4ed50-9b99-4333-aea2-48724ac9c915 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.705049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-85b4ed50-9b99-4333-aea2-48724ac9c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.705912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 781/1549] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:42.708587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98712b2-14d4-4098-808b-a75acb7fbea6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.714785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98712b2-14d4-4098-808b-a75acb7fbea6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.715793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98712b2-14d4-4098-808b-a75acb7fbea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.720903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 769/1550] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:42.730322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4ed50-9b99-4333-aea2-48724ac9c915 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.749235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4ed50-9b99-4333-aea2-48724ac9c915 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.763442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.764096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.764385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.764668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.765398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:42.765721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.770342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING py.warnings [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:42.770342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: warnings.warn(msg) Sep 01 08:15:42.770342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: Sep 01 08:15:42.770342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.783512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c98712b2-14d4-4098-808b-a75acb7fbea6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.785083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c98712b2-14d4-4098-808b-a75acb7fbea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.800867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 770/1551] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:42.801810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.803691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 782/1552] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:42.805309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc9c9-00dd-4ed3-a875-ee652a070a3b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.805804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc9c9-00dd-4ed3-a875-ee652a070a3b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.806251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc9c9-00dd-4ed3-a875-ee652a070a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.834303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7e5d3-4ffa-4251-8c9d-58e3875669ae admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.842630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-086dc9c9-00dd-4ed3-a875-ee652a070a3b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.844168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-086dc9c9-00dd-4ed3-a875-ee652a070a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.847687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2b252-0829-463d-a618-892c2b768071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.847687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2b252-0829-463d-a618-892c2b768071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.847687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2b252-0829-463d-a618-892c2b768071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.847687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2b252-0829-463d-a618-892c2b768071 admin admin] PATH_INFO: `/v3/projects/7d43ea736fc0496d841b2530242dfde6/users/854e77042ee14f7f806a33f9c9501bb0/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.875199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 783/1553] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:42.876797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dc9c9-00dd-4ed3-a875-ee652a070a3b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.879939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2b252-0829-463d-a618-892c2b768071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d43ea736fc0496d841b2530242dfde6, user_id=854e77042ee14f7f806a33f9c9501bb0, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.883478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2b252-0829-463d-a618-892c2b768071 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.907665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dc9c9-00dd-4ed3-a875-ee652a070a3b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.914848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 771/1554] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:42 2022] PUT /identity/v3/projects/7d43ea736fc0496d841b2530242dfde6/users/854e77042ee14f7f806a33f9c9501bb0/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:42.916989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2b252-0829-463d-a618-892c2b768071 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.043967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2b252-0829-463d-a618-892c2b768071 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.049489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4bd65-0cc1-4840-9789-36115a9ef28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.050320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4bd65-0cc1-4840-9789-36115a9ef28f admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.050635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4bd65-0cc1-4840-9789-36115a9ef28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.050911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4bd65-0cc1-4840-9789-36115a9ef28f admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.051626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4bd65-0cc1-4840-9789-36115a9ef28f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.053871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4bd65-0cc1-4840-9789-36115a9ef28f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.060451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:43.064947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24443c-2589-4173-84f2-40524e7f6a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.066000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24443c-2589-4173-84f2-40524e7f6a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.066892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24443c-2589-4173-84f2-40524e7f6a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.067019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24443c-2589-4173-84f2-40524e7f6a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.068374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24443c-2589-4173-84f2-40524e7f6a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:43.069034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24443c-2589-4173-84f2-40524e7f6a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.073684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24443c-2589-4173-84f2-40524e7f6a0b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.093301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 772/1555] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:43.095216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4bd65-0cc1-4840-9789-36115a9ef28f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.097852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 784/1556] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:43.100763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c05c3-8fac-4f1a-8375-fb87a111da38 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.101190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c05c3-8fac-4f1a-8375-fb87a111da38 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.101631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c05c3-8fac-4f1a-8375-fb87a111da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.140343 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c67c05c3-8fac-4f1a-8375-fb87a111da38 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.141460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c67c05c3-8fac-4f1a-8375-fb87a111da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.180046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:43.189911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4bd65-0cc1-4840-9789-36115a9ef28f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.196953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af7e42-b65d-4738-94ae-dae347ec34fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.197691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7e42-b65d-4738-94ae-dae347ec34fd admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.197881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7e42-b65d-4738-94ae-dae347ec34fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.198192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7e42-b65d-4738-94ae-dae347ec34fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.198847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af7e42-b65d-4738-94ae-dae347ec34fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:43.199196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af7e42-b65d-4738-94ae-dae347ec34fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.203348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af7e42-b65d-4738-94ae-dae347ec34fd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.225886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 773/1557] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:43.228241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91b33c-d0b6-4dd4-b97a-e72a33a1b947 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.228734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91b33c-d0b6-4dd4-b97a-e72a33a1b947 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.229242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91b33c-d0b6-4dd4-b97a-e72a33a1b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.236555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 785/1558] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.238071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428ba0d-190d-4117-80c0-9d0bb3a974b8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.238398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428ba0d-190d-4117-80c0-9d0bb3a974b8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.238683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428ba0d-190d-4117-80c0-9d0bb3a974b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.263978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a428ba0d-190d-4117-80c0-9d0bb3a974b8 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.265245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a428ba0d-190d-4117-80c0-9d0bb3a974b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.266316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-da91b33c-d0b6-4dd4-b97a-e72a33a1b947 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.268458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-da91b33c-d0b6-4dd4-b97a-e72a33a1b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.275323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 786/1559] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.276748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b338a-3a20-4120-8574-acc50b6454da None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.277040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b338a-3a20-4120-8574-acc50b6454da None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.277319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b338a-3a20-4120-8574-acc50b6454da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.290416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 774/1560] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.290416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91b33c-d0b6-4dd4-b97a-e72a33a1b947 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.300372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ca6b338a-3a20-4120-8574-acc50b6454da None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.301622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ca6b338a-3a20-4120-8574-acc50b6454da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.307418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91b33c-d0b6-4dd4-b97a-e72a33a1b947 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.311230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 787/1561] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.312084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b338a-3a20-4120-8574-acc50b6454da None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.316102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bece6-567d-4bd0-b8a0-dff7a94f2974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.317188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bece6-567d-4bd0-b8a0-dff7a94f2974 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.317701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bece6-567d-4bd0-b8a0-dff7a94f2974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.318773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bece6-567d-4bd0-b8a0-dff7a94f2974 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.320354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bece6-567d-4bd0-b8a0-dff7a94f2974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.322376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING py.warnings [None req-8f3bece6-567d-4bd0-b8a0-dff7a94f2974 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:43.322376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: warnings.warn(msg) Sep 01 08:15:43.322376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: Sep 01 08:15:43.324360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bece6-567d-4bd0-b8a0-dff7a94f2974 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.332794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b338a-3a20-4120-8574-acc50b6454da None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.339945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.340175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.340534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.340868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.341772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.343150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING py.warnings [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:43.343150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: warnings.warn(msg) Sep 01 08:15:43.343150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: Sep 01 08:15:43.344969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.361861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 775/1562] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/users => generated 292 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:43.364018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264db06e-251f-4953-b837-5f631183ea97 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.364674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264db06e-251f-4953-b837-5f631183ea97 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.365733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264db06e-251f-4953-b837-5f631183ea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.398145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-264db06e-251f-4953-b837-5f631183ea97 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.398538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 788/1563] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:43.400308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-264db06e-251f-4953-b837-5f631183ea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.402036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.499007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 776/1564] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.500400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264db06e-251f-4953-b837-5f631183ea97 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.517360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59655c44-18fe-4e76-90d1-f4543d81678b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.525373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460caff5-6a6e-4496-80a8-7829302028d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.526296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460caff5-6a6e-4496-80a8-7829302028d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.526567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460caff5-6a6e-4496-80a8-7829302028d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.526914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460caff5-6a6e-4496-80a8-7829302028d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.527786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460caff5-6a6e-4496-80a8-7829302028d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.530111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460caff5-6a6e-4496-80a8-7829302028d3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.566685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 789/1565] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:43.566685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58eed-0ce2-48d6-b0e4-e00f69fffdba None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.566685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58eed-0ce2-48d6-b0e4-e00f69fffdba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.566685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58eed-0ce2-48d6-b0e4-e00f69fffdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.592295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-efc58eed-0ce2-48d6-b0e4-e00f69fffdba None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.593876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-efc58eed-0ce2-48d6-b0e4-e00f69fffdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.594190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264db06e-251f-4953-b837-5f631183ea97 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.608022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:43.673858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620fab0-c1f0-4049-943c-76b4fbf1327a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.674594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620fab0-c1f0-4049-943c-76b4fbf1327a service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.675057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620fab0-c1f0-4049-943c-76b4fbf1327a service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.675613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620fab0-c1f0-4049-943c-76b4fbf1327a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.687191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 790/1566] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.689786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf273e-7a71-4433-864a-9cd7213e1f27 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.690288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf273e-7a71-4433-864a-9cd7213e1f27 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.690840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf273e-7a71-4433-864a-9cd7213e1f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.722779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d9bf273e-7a71-4433-864a-9cd7213e1f27 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.725000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d9bf273e-7a71-4433-864a-9cd7213e1f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.735981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 791/1567] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.738205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d39ee-98a1-46c4-8451-87448639ec2a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.738722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d39ee-98a1-46c4-8451-87448639ec2a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.739194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d39ee-98a1-46c4-8451-87448639ec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.766242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a01d39ee-98a1-46c4-8451-87448639ec2a None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.768065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a01d39ee-98a1-46c4-8451-87448639ec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.777183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620fab0-c1f0-4049-943c-76b4fbf1327a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.778772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 792/1568] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.778976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620fab0-c1f0-4049-943c-76b4fbf1327a service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.779870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d39ee-98a1-46c4-8451-87448639ec2a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.791569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d39ee-98a1-46c4-8451-87448639ec2a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.795411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 777/1569] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:43.796557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620fab0-c1f0-4049-943c-76b4fbf1327a service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.798972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e7ec4-c88f-44f0-b4a1-c3f8e333244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.800386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e7ec4-c88f-44f0-b4a1-c3f8e333244f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.801113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e7ec4-c88f-44f0-b4a1-c3f8e333244f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.801812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e7ec4-c88f-44f0-b4a1-c3f8e333244f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.803841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e7ec4-c88f-44f0-b4a1-c3f8e333244f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.807414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e7ec4-c88f-44f0-b4a1-c3f8e333244f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.812088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620fab0-c1f0-4049-943c-76b4fbf1327a service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.819349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:43.821447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fdd46-d715-41b6-90be-4850f53c1102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.822084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdd46-d715-41b6-90be-4850f53c1102 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.822498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdd46-d715-41b6-90be-4850f53c1102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.822775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdd46-d715-41b6-90be-4850f53c1102 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.823628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fdd46-d715-41b6-90be-4850f53c1102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.826211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fdd46-d715-41b6-90be-4850f53c1102 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.830894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 793/1570] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:43.834582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a24d7-2515-4b74-8573-129382f002c8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.835539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a24d7-2515-4b74-8573-129382f002c8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.836284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a24d7-2515-4b74-8573-129382f002c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.861920 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 778/1571] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/users => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:43.863044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fdd46-d715-41b6-90be-4850f53c1102 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.879335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fdd46-d715-41b6-90be-4850f53c1102 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.886543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d240b7-e57a-499d-8b4f-9bda8db97eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.887283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d240b7-e57a-499d-8b4f-9bda8db97eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.887644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d240b7-e57a-499d-8b4f-9bda8db97eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.888038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d240b7-e57a-499d-8b4f-9bda8db97eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.888769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d240b7-e57a-499d-8b4f-9bda8db97eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.889745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-da9a24d7-2515-4b74-8573-129382f002c8 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.890989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d240b7-e57a-499d-8b4f-9bda8db97eb3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.892464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-da9a24d7-2515-4b74-8573-129382f002c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.910984 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 794/1572] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:43.919145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a24d7-2515-4b74-8573-129382f002c8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.927155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 779/1573] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/users => generated 294 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:43.931803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d240b7-e57a-499d-8b4f-9bda8db97eb3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.942219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a24d7-2515-4b74-8573-129382f002c8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.948971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.949422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d240b7-e57a-499d-8b4f-9bda8db97eb3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.949632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.949898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.950166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.950993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:43.951305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.953200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.957315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.958201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.959214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.959547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.960465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:43.960952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.963766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.978305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 795/1574] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:43.978305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.997276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 780/1575] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:43.997276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.997748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af23ea1-1662-4495-a29b-2709b3202c63 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.997748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.998069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.998069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.998393 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.999047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:43.999974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.001386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.013576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aab625-ebbf-47ea-bd12-affad744ccda admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.016240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 796/1576] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:44.016848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.028147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da77b5f-de85-4493-aa92-1826481b9f2f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.031832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5d78a-ae48-40cb-b973-e1334aed7f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.032823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d78a-ae48-40cb-b973-e1334aed7f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.033487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d78a-ae48-40cb-b973-e1334aed7f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.033802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e2c07-1607-435e-8356-34c627aa0e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.034482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d78a-ae48-40cb-b973-e1334aed7f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.034774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2c07-1607-435e-8356-34c627aa0e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.034774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2c07-1607-435e-8356-34c627aa0e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.035117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2c07-1607-435e-8356-34c627aa0e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.035704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5d78a-ae48-40cb-b973-e1334aed7f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.035916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e2c07-1607-435e-8356-34c627aa0e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.038504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e2c07-1607-435e-8356-34c627aa0e16 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.039572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5d78a-ae48-40cb-b973-e1334aed7f76 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.052074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 797/1577] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:44.053932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e2c07-1607-435e-8356-34c627aa0e16 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.067316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 781/1578] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:44.067316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5d78a-ae48-40cb-b973-e1334aed7f76 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.068469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e2c07-1607-435e-8356-34c627aa0e16 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.074800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.075568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.075935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.076288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.077037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:44.077421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.080149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.080737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5d78a-ae48-40cb-b973-e1334aed7f76 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.087408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ec182-a4c9-4586-b257-65cfa01fd7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.088319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec182-a4c9-4586-b257-65cfa01fd7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.088699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec182-a4c9-4586-b257-65cfa01fd7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.089088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec182-a4c9-4586-b257-65cfa01fd7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.089934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ec182-a4c9-4586-b257-65cfa01fd7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.092798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ec182-a4c9-4586-b257-65cfa01fd7b8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.096397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 798/1579] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:44.097183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.115586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb456-50e4-47ad-aa18-7ccae2835aca admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.119267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 782/1580] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:44.120096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ec182-a4c9-4586-b257-65cfa01fd7b8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.129961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73dffa-6609-4bdc-9037-904f194a60fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.131117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73dffa-6609-4bdc-9037-904f194a60fc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.131574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73dffa-6609-4bdc-9037-904f194a60fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.132056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73dffa-6609-4bdc-9037-904f194a60fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.139301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73dffa-6609-4bdc-9037-904f194a60fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.139489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ec182-a4c9-4586-b257-65cfa01fd7b8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.139666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73dffa-6609-4bdc-9037-904f194a60fc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.156271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81975a2-49b3-4b3f-819c-aaef876064f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.157442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81975a2-49b3-4b3f-819c-aaef876064f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.157757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81975a2-49b3-4b3f-819c-aaef876064f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.158717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81975a2-49b3-4b3f-819c-aaef876064f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.160342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81975a2-49b3-4b3f-819c-aaef876064f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.164779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81975a2-49b3-4b3f-819c-aaef876064f4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.198161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 799/1581] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:44.199738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73dffa-6609-4bdc-9037-904f194a60fc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.215247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 783/1582] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:44.216884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81975a2-49b3-4b3f-819c-aaef876064f4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.277219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:44.337911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81975a2-49b3-4b3f-819c-aaef876064f4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.341441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea55b-4502-4fcd-8cca-ce35bdf4a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.343267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea55b-4502-4fcd-8cca-ce35bdf4a030 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.343761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea55b-4502-4fcd-8cca-ce35bdf4a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.344489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea55b-4502-4fcd-8cca-ce35bdf4a030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.345711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea55b-4502-4fcd-8cca-ce35bdf4a030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.349954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ea55b-4502-4fcd-8cca-ce35bdf4a030 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.371629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 784/1583] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:44.373316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea55b-4502-4fcd-8cca-ce35bdf4a030 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.374892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73dffa-6609-4bdc-9037-904f194a60fc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.387004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc5891-5b5a-47da-bad2-b7c59ad83f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.389601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5891-5b5a-47da-bad2-b7c59ad83f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.390430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5891-5b5a-47da-bad2-b7c59ad83f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.390955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ea55b-4502-4fcd-8cca-ce35bdf4a030 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.391503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5891-5b5a-47da-bad2-b7c59ad83f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.392862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc5891-5b5a-47da-bad2-b7c59ad83f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.396882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc5891-5b5a-47da-bad2-b7c59ad83f31 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.401466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb90c71-11ea-4cfe-b114-f3862c0b9816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.404798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90c71-11ea-4cfe-b114-f3862c0b9816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.405992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90c71-11ea-4cfe-b114-f3862c0b9816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.406648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb90c71-11ea-4cfe-b114-f3862c0b9816 admin admin] PATH_INFO: `/v3/projects/5659ecaff9de446cbf9c79f301c0b994/users/cc8ef450fa994dd2a17d1815750f5dd3/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.440594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb90c71-11ea-4cfe-b114-f3862c0b9816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5659ecaff9de446cbf9c79f301c0b994, user_id=cc8ef450fa994dd2a17d1815750f5dd3, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.448855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb90c71-11ea-4cfe-b114-f3862c0b9816 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.465465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 800/1584] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/projects => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:44.465465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc5891-5b5a-47da-bad2-b7c59ad83f31 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.480684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 785/1585] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:44 2022] PUT /identity/v3/projects/5659ecaff9de446cbf9c79f301c0b994/users/cc8ef450fa994dd2a17d1815750f5dd3/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:44.492191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb90c71-11ea-4cfe-b114-f3862c0b9816 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.589741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc5891-5b5a-47da-bad2-b7c59ad83f31 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.611626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:44.613653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb90c71-11ea-4cfe-b114-f3862c0b9816 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.622326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4ccb1-4255-4809-bf81-f6f53d16335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.623451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ccb1-4255-4809-bf81-f6f53d16335d admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.623969 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ccb1-4255-4809-bf81-f6f53d16335d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.624509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ccb1-4255-4809-bf81-f6f53d16335d admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.625706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4ccb1-4255-4809-bf81-f6f53d16335d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.628638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4ccb1-4255-4809-bf81-f6f53d16335d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.649408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 786/1586] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:44.654681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4ccb1-4255-4809-bf81-f6f53d16335d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.673522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4ccb1-4255-4809-bf81-f6f53d16335d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.683462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56bdd0-fbcc-4b9c-ab93-878cff16d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.684503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56bdd0-fbcc-4b9c-ab93-878cff16d5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.684951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56bdd0-fbcc-4b9c-ab93-878cff16d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.685467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56bdd0-fbcc-4b9c-ab93-878cff16d5ca admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.686863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56bdd0-fbcc-4b9c-ab93-878cff16d5ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.690599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56bdd0-fbcc-4b9c-ab93-878cff16d5ca admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.708224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c253-b1a6-4e20-8af5-5b167dcecf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.710622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c253-b1a6-4e20-8af5-5b167dcecf75 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.711964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c253-b1a6-4e20-8af5-5b167dcecf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.712821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c253-b1a6-4e20-8af5-5b167dcecf75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.714296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c253-b1a6-4e20-8af5-5b167dcecf75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.718629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c253-b1a6-4e20-8af5-5b167dcecf75 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.734618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 787/1587] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/users => generated 303 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:44.734618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56bdd0-fbcc-4b9c-ab93-878cff16d5ca admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.752267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56bdd0-fbcc-4b9c-ab93-878cff16d5ca admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.761803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56654b58-2672-4af7-9c25-7a23bb82eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.762963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654b58-2672-4af7-9c25-7a23bb82eec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.763584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654b58-2672-4af7-9c25-7a23bb82eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.764210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654b58-2672-4af7-9c25-7a23bb82eec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.765491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56654b58-2672-4af7-9c25-7a23bb82eec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.769091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56654b58-2672-4af7-9c25-7a23bb82eec9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.775710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 801/1588] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:44.776813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c253-b1a6-4e20-8af5-5b167dcecf75 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.810784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 788/1589] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/users => generated 295 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:44.812390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56654b58-2672-4af7-9c25-7a23bb82eec9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.831859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56654b58-2672-4af7-9c25-7a23bb82eec9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.896897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c253-b1a6-4e20-8af5-5b167dcecf75 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.907461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860cdfb-4f95-4688-8725-2532fec42134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.909709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860cdfb-4f95-4688-8725-2532fec42134 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.910531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860cdfb-4f95-4688-8725-2532fec42134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.911026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860cdfb-4f95-4688-8725-2532fec42134 admin admin] PATH_INFO: `/v3/projects/e17cd7e07aa94984a3ecdb3fbce1b097/users/c5d55971cbce4c61a81b158aa666e2ea/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.950041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860cdfb-4f95-4688-8725-2532fec42134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17cd7e07aa94984a3ecdb3fbce1b097, user_id=c5d55971cbce4c61a81b158aa666e2ea, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.952028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING py.warnings [None req-5860cdfb-4f95-4688-8725-2532fec42134 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:44.952028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: warnings.warn(msg) Sep 01 08:15:44.952028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: Sep 01 08:15:44.956536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860cdfb-4f95-4688-8725-2532fec42134 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.989024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 802/1590] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:44 2022] PUT /identity/v3/projects/e17cd7e07aa94984a3ecdb3fbce1b097/users/c5d55971cbce4c61a81b158aa666e2ea/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:44.991402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c6bb3-2e6c-4a93-b3ff-97e3bec7b1b4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.992069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c6bb3-2e6c-4a93-b3ff-97e3bec7b1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.992552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c6bb3-2e6c-4a93-b3ff-97e3bec7b1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.995678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e405f-eb6c-4f82-856e-45aef7a21c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.996338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e405f-eb6c-4f82-856e-45aef7a21c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.996639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e405f-eb6c-4f82-856e-45aef7a21c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.996916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e405f-eb6c-4f82-856e-45aef7a21c28 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.997581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e405f-eb6c-4f82-856e-45aef7a21c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.999624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e405f-eb6c-4f82-856e-45aef7a21c28 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.024145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:45.047983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-394c6bb3-2e6c-4a93-b3ff-97e3bec7b1b4 None None] MFA Rules not processed for user `cc8ef450fa994dd2a17d1815750f5dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:45.050583 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-394c6bb3-2e6c-4a93-b3ff-97e3bec7b1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.061486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 789/1591] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:45.061698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e405f-eb6c-4f82-856e-45aef7a21c28 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.078652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e405f-eb6c-4f82-856e-45aef7a21c28 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.164037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72365c3-e514-40f6-a903-86ce417b759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.164860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72365c3-e514-40f6-a903-86ce417b759a admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.165149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72365c3-e514-40f6-a903-86ce417b759a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.165429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72365c3-e514-40f6-a903-86ce417b759a admin admin] PATH_INFO: `/v3/projects/60ad47f23a454aa8a024cbbe879b2a94/users/d7b60860ba684a508a7645b8410e0e78/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.185898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72365c3-e514-40f6-a903-86ce417b759a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ad47f23a454aa8a024cbbe879b2a94, user_id=d7b60860ba684a508a7645b8410e0e78, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.188678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72365c3-e514-40f6-a903-86ce417b759a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.199218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 803/1592] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:45.201049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c6bb3-2e6c-4a93-b3ff-97e3bec7b1b4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.215046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 790/1593] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:45 2022] PUT /identity/v3/projects/60ad47f23a454aa8a024cbbe879b2a94/users/d7b60860ba684a508a7645b8410e0e78/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:45.216186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72365c3-e514-40f6-a903-86ce417b759a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.246031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c6bb3-2e6c-4a93-b3ff-97e3bec7b1b4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.288443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:45.305259 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72365c3-e514-40f6-a903-86ce417b759a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.312226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8addc-d446-4fc2-af53-0e462b4104b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.312867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8addc-d446-4fc2-af53-0e462b4104b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.313152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8addc-d446-4fc2-af53-0e462b4104b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.313435 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8addc-d446-4fc2-af53-0e462b4104b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.314081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8addc-d446-4fc2-af53-0e462b4104b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.316220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8addc-d446-4fc2-af53-0e462b4104b7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.349501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 791/1594] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:45 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:45.351374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8addc-d446-4fc2-af53-0e462b4104b7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.370525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8addc-d446-4fc2-af53-0e462b4104b7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.378092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a80f2b-64ca-4cc9-ac41-d0f9c436ad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.378928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a80f2b-64ca-4cc9-ac41-d0f9c436ad29 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.379285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a80f2b-64ca-4cc9-ac41-d0f9c436ad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.379637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a80f2b-64ca-4cc9-ac41-d0f9c436ad29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.382275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a80f2b-64ca-4cc9-ac41-d0f9c436ad29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.384220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a80f2b-64ca-4cc9-ac41-d0f9c436ad29 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.393592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a2e32-c6c1-43e1-b2b5-beebc6fd74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.394524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a2e32-c6c1-43e1-b2b5-beebc6fd74c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.394811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a2e32-c6c1-43e1-b2b5-beebc6fd74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.395086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a2e32-c6c1-43e1-b2b5-beebc6fd74c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.395916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a2e32-c6c1-43e1-b2b5-beebc6fd74c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.397950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a2e32-c6c1-43e1-b2b5-beebc6fd74c0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.398833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 792/1595] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:45.400396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c431b-d89f-4c25-b6c7-3a2426fbbe21 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.400686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c431b-d89f-4c25-b6c7-3a2426fbbe21 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.401122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c431b-d89f-4c25-b6c7-3a2426fbbe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.413228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 804/1596] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:45.414637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a2e32-c6c1-43e1-b2b5-beebc6fd74c0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.429502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e86c431b-d89f-4c25-b6c7-3a2426fbbe21 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:45.429842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a2e32-c6c1-43e1-b2b5-beebc6fd74c0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.430877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e86c431b-d89f-4c25-b6c7-3a2426fbbe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.436257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813786a-f15e-46d2-af4b-8357090fa21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.437224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813786a-f15e-46d2-af4b-8357090fa21d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.437675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813786a-f15e-46d2-af4b-8357090fa21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.438086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813786a-f15e-46d2-af4b-8357090fa21d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.439254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813786a-f15e-46d2-af4b-8357090fa21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.441598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813786a-f15e-46d2-af4b-8357090fa21d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.450408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 793/1597] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:45.451855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e930ee-d187-4846-aab7-f2e7bf9b21ca None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.452129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e930ee-d187-4846-aab7-f2e7bf9b21ca None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.452417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e930ee-d187-4846-aab7-f2e7bf9b21ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.458598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 805/1598] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:45.460549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f4ae7-0f79-4d11-a74f-3e547ea0a5ac None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.460944 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f4ae7-0f79-4d11-a74f-3e547ea0a5ac None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.461347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f4ae7-0f79-4d11-a74f-3e547ea0a5ac None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.468718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 806/1599] 10.222.0.43 () {54 vars in 962 bytes} [Thu Sep 1 08:15:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:15:45.469841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f4ae7-0f79-4d11-a74f-3e547ea0a5ac None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.491450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f4ae7-0f79-4d11-a74f-3e547ea0a5ac None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.497352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-11e930ee-d187-4846-aab7-f2e7bf9b21ca None None] MFA Rules not processed for user `d7b60860ba684a508a7645b8410e0e78`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:45.497936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e1ce1-6a0b-4b57-8429-650ae3138f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.498844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-11e930ee-d187-4846-aab7-f2e7bf9b21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.499370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1ce1-6a0b-4b57-8429-650ae3138f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.499757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1ce1-6a0b-4b57-8429-650ae3138f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.500252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1ce1-6a0b-4b57-8429-650ae3138f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.501376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e1ce1-6a0b-4b57-8429-650ae3138f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.503711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e1ce1-6a0b-4b57-8429-650ae3138f59 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.520479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 807/1600] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:45.525127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e1ce1-6a0b-4b57-8429-650ae3138f59 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.542772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e1ce1-6a0b-4b57-8429-650ae3138f59 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.551367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bbe37-d6fd-41e5-aa44-552e9508e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.552845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbe37-d6fd-41e5-aa44-552e9508e7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.553233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbe37-d6fd-41e5-aa44-552e9508e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.553586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bbe37-d6fd-41e5-aa44-552e9508e7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.555901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bbe37-d6fd-41e5-aa44-552e9508e7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.557462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bbe37-d6fd-41e5-aa44-552e9508e7a3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.562863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:45.581527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 808/1601] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:45.581527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bbe37-d6fd-41e5-aa44-552e9508e7a3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.595461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bbe37-d6fd-41e5-aa44-552e9508e7a3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.603437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 794/1602] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:45.604438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e930ee-d187-4846-aab7-f2e7bf9b21ca None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.609319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1375b4-cc92-413c-802c-84b589ff6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.610181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1375b4-cc92-413c-802c-84b589ff6aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.610777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1375b4-cc92-413c-802c-84b589ff6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.611188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1375b4-cc92-413c-802c-84b589ff6aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.612669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1375b4-cc92-413c-802c-84b589ff6aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.616143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1375b4-cc92-413c-802c-84b589ff6aa2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.621071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e930ee-d187-4846-aab7-f2e7bf9b21ca None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.627267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b209cd4-6e67-432a-8f9c-6374045ce052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.628063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b209cd4-6e67-432a-8f9c-6374045ce052 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.628415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b209cd4-6e67-432a-8f9c-6374045ce052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.628762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b209cd4-6e67-432a-8f9c-6374045ce052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.629566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 809/1603] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:45.630692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1375b4-cc92-413c-802c-84b589ff6aa2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.634402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b209cd4-6e67-432a-8f9c-6374045ce052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.637016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b209cd4-6e67-432a-8f9c-6374045ce052 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.655289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 795/1604] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:45.657939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cdfe0-eeff-4631-946e-34ece6eb03aa None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.658297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cdfe0-eeff-4631-946e-34ece6eb03aa None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.658688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cdfe0-eeff-4631-946e-34ece6eb03aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.719036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1375b4-cc92-413c-802c-84b589ff6aa2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.721707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-811cdfe0-eeff-4631-946e-34ece6eb03aa None None] MFA Rules not processed for user `7949d9285d4e4c908c377a0ac16dd14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:45.725013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823b52a-fdeb-4def-b7ab-7f587774712b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.725651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b52a-fdeb-4def-b7ab-7f587774712b service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.725926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-811cdfe0-eeff-4631-946e-34ece6eb03aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.726221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b52a-fdeb-4def-b7ab-7f587774712b service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.726543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b52a-fdeb-4def-b7ab-7f587774712b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.739037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b52a-fdeb-4def-b7ab-7f587774712b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.741874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b52a-fdeb-4def-b7ab-7f587774712b service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.758293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 810/1605] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:45.759245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823b52a-fdeb-4def-b7ab-7f587774712b service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.770641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823b52a-fdeb-4def-b7ab-7f587774712b service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.778096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ebca7-2d78-4d9c-8e73-a9c64ce7a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.778769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ebca7-2d78-4d9c-8e73-a9c64ce7a4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.779055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ebca7-2d78-4d9c-8e73-a9c64ce7a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.779335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ebca7-2d78-4d9c-8e73-a9c64ce7a4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.779996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ebca7-2d78-4d9c-8e73-a9c64ce7a4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.781841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ebca7-2d78-4d9c-8e73-a9c64ce7a4a8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.801884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 811/1606] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:45.802989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ebca7-2d78-4d9c-8e73-a9c64ce7a4a8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.819587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ebca7-2d78-4d9c-8e73-a9c64ce7a4a8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.827236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22577f-7712-4acc-8f90-670aab34d016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.827878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22577f-7712-4acc-8f90-670aab34d016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.828165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22577f-7712-4acc-8f90-670aab34d016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.828443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22577f-7712-4acc-8f90-670aab34d016 admin admin] PATH_INFO: `/v3/projects/631e2e8467654c0ea799bf50fed7afad/users/7559a0b8d46b4524b40f68b992f6cfe9/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.865066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22577f-7712-4acc-8f90-670aab34d016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631e2e8467654c0ea799bf50fed7afad, user_id=7559a0b8d46b4524b40f68b992f6cfe9, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.871120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22577f-7712-4acc-8f90-670aab34d016 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.898580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 812/1607] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:45 2022] PUT /identity/v3/projects/631e2e8467654c0ea799bf50fed7afad/users/7559a0b8d46b4524b40f68b992f6cfe9/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:45.900078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22577f-7712-4acc-8f90-670aab34d016 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.923147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 796/1608] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Sep 1 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:45.925595 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cdfe0-eeff-4631-946e-34ece6eb03aa None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.949522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cdfe0-eeff-4631-946e-34ece6eb03aa None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.003360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:46.080929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22577f-7712-4acc-8f90-670aab34d016 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.096824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a17b9-f703-4dc0-a7ac-ff20237985ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.097520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a17b9-f703-4dc0-a7ac-ff20237985ad admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.097952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a17b9-f703-4dc0-a7ac-ff20237985ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.098205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a17b9-f703-4dc0-a7ac-ff20237985ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.099869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a17b9-f703-4dc0-a7ac-ff20237985ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:46.105751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850e071-6d83-4e2d-9449-c729d441c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.106762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a17b9-f703-4dc0-a7ac-ff20237985ad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:46.112131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850e071-6d83-4e2d-9449-c729d441c900 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.113408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850e071-6d83-4e2d-9449-c729d441c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.117645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850e071-6d83-4e2d-9449-c729d441c900 admin admin] PATH_INFO: `/v3/projects/0f49f08b993746c6a4a5ce8fab41d35e/users/038771ae63ab4206ad78ac1e9b57ed6a/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.172524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 813/1609] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:45 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:46.173588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a17b9-f703-4dc0-a7ac-ff20237985ad admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:46.219002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850e071-6d83-4e2d-9449-c729d441c900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f49f08b993746c6a4a5ce8fab41d35e, user_id=038771ae63ab4206ad78ac1e9b57ed6a, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:46.221962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850e071-6d83-4e2d-9449-c729d441c900 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:46.257477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 797/1610] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:45 2022] PUT /identity/v3/projects/0f49f08b993746c6a4a5ce8fab41d35e/users/038771ae63ab4206ad78ac1e9b57ed6a/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:46.258243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850e071-6d83-4e2d-9449-c729d441c900 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:46.328512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:46.366837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a17b9-f703-4dc0-a7ac-ff20237985ad admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.429111 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850e071-6d83-4e2d-9449-c729d441c900 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.457400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56fff8-8fe0-43ea-ba9a-3635f58aa91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.464029 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fff8-8fe0-43ea-ba9a-3635f58aa91a admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.464320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fff8-8fe0-43ea-ba9a-3635f58aa91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.464602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fff8-8fe0-43ea-ba9a-3635f58aa91a admin admin] PATH_INFO: `/v3/projects/b2e0d80b70984b39a3a4c07d0018f67b/users/eaf3d36d40d442019e09a3e4c32b8330/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.533961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fff8-8fe0-43ea-ba9a-3635f58aa91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e0d80b70984b39a3a4c07d0018f67b, user_id=eaf3d36d40d442019e09a3e4c32b8330, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:46.540482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fff8-8fe0-43ea-ba9a-3635f58aa91a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:46.571820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 798/1611] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:46 2022] PUT /identity/v3/projects/b2e0d80b70984b39a3a4c07d0018f67b/users/eaf3d36d40d442019e09a3e4c32b8330/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:46.574157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef33e-4945-4285-b672-0d46e9414a21 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.575314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef33e-4945-4285-b672-0d46e9414a21 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.575496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddef33e-4945-4285-b672-0d46e9414a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.600368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049429-785a-45c2-abdb-eb3577a6041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.601079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049429-785a-45c2-abdb-eb3577a6041a admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.601360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049429-785a-45c2-abdb-eb3577a6041a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.601633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049429-785a-45c2-abdb-eb3577a6041a admin admin] PATH_INFO: `/v3/projects/fc1b2d8410c24838992be4ea0d1667db/users/0381f64a943848fb887248531104b4b2/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.647231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63049429-785a-45c2-abdb-eb3577a6041a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1b2d8410c24838992be4ea0d1667db, user_id=0381f64a943848fb887248531104b4b2, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:46.649422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6ddef33e-4945-4285-b672-0d46e9414a21 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:46.650341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63049429-785a-45c2-abdb-eb3577a6041a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:46.652047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6ddef33e-4945-4285-b672-0d46e9414a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:46.686926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 814/1612] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:46 2022] PUT /identity/v3/projects/fc1b2d8410c24838992be4ea0d1667db/users/0381f64a943848fb887248531104b4b2/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:46.690748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049429-785a-45c2-abdb-eb3577a6041a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:46.864321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:46.864321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049429-785a-45c2-abdb-eb3577a6041a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.865254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 799/1613] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:46.865254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddef33e-4945-4285-b672-0d46e9414a21 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:46.865712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729719c2-0eaf-4da7-8feb-7b0374f44680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.865712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729719c2-0eaf-4da7-8feb-7b0374f44680 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.865712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729719c2-0eaf-4da7-8feb-7b0374f44680 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.865712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729719c2-0eaf-4da7-8feb-7b0374f44680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.866310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddef33e-4945-4285-b672-0d46e9414a21 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.905450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060f45-bd12-4cf1-bfa9-5fb39899b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.910089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060f45-bd12-4cf1-bfa9-5fb39899b71a admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.910378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060f45-bd12-4cf1-bfa9-5fb39899b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.910640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060f45-bd12-4cf1-bfa9-5fb39899b71a admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.913615 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3060f45-bd12-4cf1-bfa9-5fb39899b71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:46.916194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3060f45-bd12-4cf1-bfa9-5fb39899b71a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:46.962513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 800/1614] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:46 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:46.964502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4cd28-ff7c-422a-b369-088387ab0135 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.965008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4cd28-ff7c-422a-b369-088387ab0135 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.965292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4cd28-ff7c-422a-b369-088387ab0135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.009213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729719c2-0eaf-4da7-8feb-7b0374f44680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.009594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-59e4cd28-ff7c-422a-b369-088387ab0135 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.011227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729719c2-0eaf-4da7-8feb-7b0374f44680 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.013724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-59e4cd28-ff7c-422a-b369-088387ab0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.034251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 815/1615] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:47.035810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46786-f103-40e4-a817-4d6eb7552d50 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.039226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 801/1616] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:47.040586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46786-f103-40e4-a817-4d6eb7552d50 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.040917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46786-f103-40e4-a817-4d6eb7552d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.043133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf0256-8b2c-4a74-8218-3c1b1558caf3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.043774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf0256-8b2c-4a74-8218-3c1b1558caf3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.044380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf0256-8b2c-4a74-8218-3c1b1558caf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.098666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-90d46786-f103-40e4-a817-4d6eb7552d50 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.104680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90d46786-f103-40e4-a817-4d6eb7552d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.109916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-32cf0256-8b2c-4a74-8218-3c1b1558caf3 None None] MFA Rules not processed for user `0381f64a943848fb887248531104b4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.112028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-32cf0256-8b2c-4a74-8218-3c1b1558caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.125930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 816/1617] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:47.134783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d46786-f103-40e4-a817-4d6eb7552d50 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.148215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d46786-f103-40e4-a817-4d6eb7552d50 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.153687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.154576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.155042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.155325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.156098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.158294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.172731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 817/1618] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:47.173774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.178441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.260450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755ed25-27df-4d8c-b5db-62a7faa3088f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.264883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9aa1f-a18b-4a83-9eae-f11ebc51e435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.265832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9aa1f-a18b-4a83-9eae-f11ebc51e435 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.266296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9aa1f-a18b-4a83-9eae-f11ebc51e435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.270121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9aa1f-a18b-4a83-9eae-f11ebc51e435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.288145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9aa1f-a18b-4a83-9eae-f11ebc51e435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.289807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9aa1f-a18b-4a83-9eae-f11ebc51e435 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.311205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 818/1619] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:47.312319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9aa1f-a18b-4a83-9eae-f11ebc51e435 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.324291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9aa1f-a18b-4a83-9eae-f11ebc51e435 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.331983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aaa45-7a11-4687-b2cf-a3f938f0bf36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.332677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aaa45-7a11-4687-b2cf-a3f938f0bf36 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.333014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aaa45-7a11-4687-b2cf-a3f938f0bf36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.333283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aaa45-7a11-4687-b2cf-a3f938f0bf36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.367923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aaa45-7a11-4687-b2cf-a3f938f0bf36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.370103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 802/1620] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:47.371023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf0256-8b2c-4a74-8218-3c1b1558caf3 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.372999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aaa45-7a11-4687-b2cf-a3f938f0bf36 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.383705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf0256-8b2c-4a74-8218-3c1b1558caf3 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.389854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872aaad9-6ca3-4208-a669-c8006b808469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.390910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aaad9-6ca3-4208-a669-c8006b808469 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.391371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aaad9-6ca3-4208-a669-c8006b808469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.392102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aaad9-6ca3-4208-a669-c8006b808469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.408608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 819/1621] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:47.412857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aaad9-6ca3-4208-a669-c8006b808469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.414709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aaa45-7a11-4687-b2cf-a3f938f0bf36 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.419045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aaad9-6ca3-4208-a669-c8006b808469 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.438199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aaa45-7a11-4687-b2cf-a3f938f0bf36 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.447108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 803/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:47.450121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c595c-2adb-45e0-8bb3-d60a7a5c25c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.451501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c595c-2adb-45e0-8bb3-d60a7a5c25c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.451932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c595c-2adb-45e0-8bb3-d60a7a5c25c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.452173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c595c-2adb-45e0-8bb3-d60a7a5c25c8 admin admin] PATH_INFO: `/v3/projects/668c11e61f7845bb9e5ea25feb9a542b/users/b406ef7f7b634cc8a7e4806f817d75e7/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.488769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe14d-f70c-4772-a461-2559b6a419ef None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.489842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe14d-f70c-4772-a461-2559b6a419ef None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.490300 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe14d-f70c-4772-a461-2559b6a419ef None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.493178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 804/1623] 10.222.0.43 () {54 vars in 962 bytes} [Thu Sep 1 08:15:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:15:47.498667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c595c-2adb-45e0-8bb3-d60a7a5c25c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668c11e61f7845bb9e5ea25feb9a542b, user_id=b406ef7f7b634cc8a7e4806f817d75e7, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.505520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834cf14-04db-4e39-97c4-38ac91642854 None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.506021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834cf14-04db-4e39-97c4-38ac91642854 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.506545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834cf14-04db-4e39-97c4-38ac91642854 None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.506874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c595c-2adb-45e0-8bb3-d60a7a5c25c8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.510393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 805/1624] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 08:15:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:15:47.514444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05de9-d7f8-47ed-abf0-fdb898ca359e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.515872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05de9-d7f8-47ed-abf0-fdb898ca359e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.516699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a05de9-d7f8-47ed-abf0-fdb898ca359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.544137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.545329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 820/1625] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:47 2022] PUT /identity/v3/projects/668c11e61f7845bb9e5ea25feb9a542b/users/b406ef7f7b634cc8a7e4806f817d75e7/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:47.548968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa15e9-b1f4-47a8-8bdc-84f73e1e5d2c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.549310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa15e9-b1f4-47a8-8bdc-84f73e1e5d2c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.549670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa15e9-b1f4-47a8-8bdc-84f73e1e5d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.581255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-54a05de9-d7f8-47ed-abf0-fdb898ca359e None None] MFA Rules not processed for user `7949d9285d4e4c908c377a0ac16dd14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.585012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-54a05de9-d7f8-47ed-abf0-fdb898ca359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.623011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6eaa15e9-b1f4-47a8-8bdc-84f73e1e5d2c None None] MFA Rules not processed for user `7949d9285d4e4c908c377a0ac16dd14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.625005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6eaa15e9-b1f4-47a8-8bdc-84f73e1e5d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.677684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.803539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 821/1626] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:47.804759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa15e9-b1f4-47a8-8bdc-84f73e1e5d2c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.822468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 806/1627] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:47.825146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a05de9-d7f8-47ed-abf0-fdb898ca359e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.851725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a05de9-d7f8-47ed-abf0-fdb898ca359e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.870469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b536ff-d35d-492a-82c7-51f34301a266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.871126 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b536ff-d35d-492a-82c7-51f34301a266 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.872145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b536ff-d35d-492a-82c7-51f34301a266 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.872145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b536ff-d35d-492a-82c7-51f34301a266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.990424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa15e9-b1f4-47a8-8bdc-84f73e1e5d2c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.011062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89922bb8-456d-4ad2-a166-3b0312e14ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.012207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922bb8-456d-4ad2-a166-3b0312e14ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.012696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922bb8-456d-4ad2-a166-3b0312e14ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.013181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922bb8-456d-4ad2-a166-3b0312e14ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.019367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89922bb8-456d-4ad2-a166-3b0312e14ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.025102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89922bb8-456d-4ad2-a166-3b0312e14ba5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.031848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b536ff-d35d-492a-82c7-51f34301a266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.034107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b536ff-d35d-492a-82c7-51f34301a266 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.054835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 807/1628] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:48.070783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 822/1629] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:48.075957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89922bb8-456d-4ad2-a166-3b0312e14ba5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.084682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b536ff-d35d-492a-82c7-51f34301a266 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.116748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89922bb8-456d-4ad2-a166-3b0312e14ba5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.136593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b38bf-118a-4de3-8b70-0efeba9c7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.137503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b38bf-118a-4de3-8b70-0efeba9c7989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.138064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b38bf-118a-4de3-8b70-0efeba9c7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.138465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b38bf-118a-4de3-8b70-0efeba9c7989 admin admin] PATH_INFO: `/v3/projects/668c11e61f7845bb9e5ea25feb9a542b/users/b406ef7f7b634cc8a7e4806f817d75e7/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.158363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b38bf-118a-4de3-8b70-0efeba9c7989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668c11e61f7845bb9e5ea25feb9a542b, user_id=b406ef7f7b634cc8a7e4806f817d75e7, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.165591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b38bf-118a-4de3-8b70-0efeba9c7989 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.216681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 823/1630] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:48 2022] PUT /identity/v3/projects/668c11e61f7845bb9e5ea25feb9a542b/users/b406ef7f7b634cc8a7e4806f817d75e7/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:48.228300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a84f-cbff-4eca-b770-f48ac3748caf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.228759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a84f-cbff-4eca-b770-f48ac3748caf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.229214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a84f-cbff-4eca-b770-f48ac3748caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.324861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b536ff-d35d-492a-82c7-51f34301a266 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.348175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4305a84f-cbff-4eca-b770-f48ac3748caf None None] MFA Rules not processed for user `b406ef7f7b634cc8a7e4806f817d75e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:48.355741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4305a84f-cbff-4eca-b770-f48ac3748caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:48.465623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82402299-59d7-460f-8044-319de21fe5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.466664 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402299-59d7-460f-8044-319de21fe5fc service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.466807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402299-59d7-460f-8044-319de21fe5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.467080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402299-59d7-460f-8044-319de21fe5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.472008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:48.579755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82402299-59d7-460f-8044-319de21fe5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.581704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82402299-59d7-460f-8044-319de21fe5fc service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.599348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 808/1631] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:48.751296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 824/1632] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:48.780015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82402299-59d7-460f-8044-319de21fe5fc service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.794122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82402299-59d7-460f-8044-319de21fe5fc service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.808379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe271a-365a-42c8-98bb-239203d45c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.809847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe271a-365a-42c8-98bb-239203d45c3d service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.814076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe271a-365a-42c8-98bb-239203d45c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.815168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe271a-365a-42c8-98bb-239203d45c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.851294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe271a-365a-42c8-98bb-239203d45c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.854451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe271a-365a-42c8-98bb-239203d45c3d service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.885879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16fd33-f30f-4d7d-9990-b41612a9cab6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.886172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16fd33-f30f-4d7d-9990-b41612a9cab6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.886457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16fd33-f30f-4d7d-9990-b41612a9cab6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.888880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 825/1633] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 08:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:15:48.902943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 809/1634] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:15:48.904456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3757a-e716-48c5-96ea-2e4a09c6eed6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.904746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3757a-e716-48c5-96ea-2e4a09c6eed6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.905027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3757a-e716-48c5-96ea-2e4a09c6eed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.935599 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-07a3757a-e716-48c5-96ea-2e4a09c6eed6 None None] MFA Rules not processed for user `7949d9285d4e4c908c377a0ac16dd14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:48.936850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-07a3757a-e716-48c5-96ea-2e4a09c6eed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:48.969220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 826/1635] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:15:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:48.993970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe271a-365a-42c8-98bb-239203d45c3d service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.021612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3757a-e716-48c5-96ea-2e4a09c6eed6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.041157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3757a-e716-48c5-96ea-2e4a09c6eed6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.056631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26341caf-ebdc-44be-870a-788ef655f8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.057289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26341caf-ebdc-44be-870a-788ef655f8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.057570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26341caf-ebdc-44be-870a-788ef655f8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.059095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26341caf-ebdc-44be-870a-788ef655f8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.098113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26341caf-ebdc-44be-870a-788ef655f8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.101100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26341caf-ebdc-44be-870a-788ef655f8b2 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.136132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 827/1636] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:15:49.241293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe271a-365a-42c8-98bb-239203d45c3d service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.276703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.277575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.278756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.280180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] PATH_INFO: `/v3/users/d7b60860ba684a508a7645b8410e0e78` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.285898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b60860ba684a508a7645b8410e0e78)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.289232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.539756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b60860ba684a508a7645b8410e0e78'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:49.617749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b60860ba684a508a7645b8410e0e78'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:49.619885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b60860ba684a508a7645b8410e0e78'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:49.649766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b60860ba684a508a7645b8410e0e78'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:49.708528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d4e59f9a-aa98-41c0-9392-7ae6a6a54add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b60860ba684a508a7645b8410e0e78'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:49.716186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:49.752925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26341caf-ebdc-44be-870a-788ef655f8b2 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.761733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 810/1637] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:48 2022] DELETE /identity/v3/users/d7b60860ba684a508a7645b8410e0e78 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:49.765381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb36b48-e63e-499b-8f58-c3806f225083 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.766069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb36b48-e63e-499b-8f58-c3806f225083 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.771115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb36b48-e63e-499b-8f58-c3806f225083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.810410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26341caf-ebdc-44be-870a-788ef655f8b2 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.854571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ebb36b48-e63e-499b-8f58-c3806f225083 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:49.856646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ebb36b48-e63e-499b-8f58-c3806f225083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:49.866554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:50.093098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:50.094328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.094883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.095373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] PATH_INFO: `/v3/users/0381f64a943848fb887248531104b4b2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.097888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0381f64a943848fb887248531104b4b2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:50.100939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: WARNING py.warnings [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:50.100939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: warnings.warn(msg) Sep 01 08:15:50.100939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: Sep 01 08:15:50.109570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:50.199933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 811/1638] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:50.298843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0381f64a943848fb887248531104b4b2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:50.302811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0381f64a943848fb887248531104b4b2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:50.303857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0381f64a943848fb887248531104b4b2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:50.316116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0381f64a943848fb887248531104b4b2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:50.316820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-78e80f8b-9a1c-48a1-9986-dd615698b0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0381f64a943848fb887248531104b4b2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:50.345577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb36b48-e63e-499b-8f58-c3806f225083 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:50.347097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ebb36b48-e63e-499b-8f58-c3806f225083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:50.386999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 828/1639] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:49 2022] DELETE /identity/v3/users/0381f64a943848fb887248531104b4b2 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:50.394244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ccb2d-0618-44b8-8c95-83a77f5d1f6b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.394716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ccb2d-0618-44b8-8c95-83a77f5d1f6b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.394905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ccb2d-0618-44b8-8c95-83a77f5d1f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.454544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b24ccb2d-0618-44b8-8c95-83a77f5d1f6b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:50.457103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b24ccb2d-0618-44b8-8c95-83a77f5d1f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:50.530497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb36b48-e63e-499b-8f58-c3806f225083 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:50.674718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 829/1640] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:50.703054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaeb63-fc6e-445c-9bf7-23c42c538bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:50.703859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaeb63-fc6e-445c-9bf7-23c42c538bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.704317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaeb63-fc6e-445c-9bf7-23c42c538bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.704870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaeb63-fc6e-445c-9bf7-23c42c538bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.706679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ceeaeb63-fc6e-445c-9bf7-23c42c538bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:50.730381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ccb2d-0618-44b8-8c95-83a77f5d1f6b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:50.732709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b24ccb2d-0618-44b8-8c95-83a77f5d1f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:50.734037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaeb63-fc6e-445c-9bf7-23c42c538bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:50.738641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaeb63-fc6e-445c-9bf7-23c42c538bf0 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:50.757257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ccb2d-0618-44b8-8c95-83a77f5d1f6b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:50.769061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:50.770337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.771545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.774961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 812/1641] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:50.775180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.789208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:50.791200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:50.806734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 830/1642] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:15:51.055856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611343ce-4f54-47a7-b7dd-5b7c9cb98286 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.056323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611343ce-4f54-47a7-b7dd-5b7c9cb98286 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.056750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611343ce-4f54-47a7-b7dd-5b7c9cb98286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.139361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-611343ce-4f54-47a7-b7dd-5b7c9cb98286 None None] MFA Rules not processed for user `038771ae63ab4206ad78ac1e9b57ed6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:51.140787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-611343ce-4f54-47a7-b7dd-5b7c9cb98286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:51.272853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:51.328382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 813/1643] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:51.333766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.335692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:51.373661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703be99a-c933-4dfa-adaa-d10a1d0bc7a8 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:51.400466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734aae5-e5bb-4a32-a0b7-d4813412e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.401112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aae5-e5bb-4a32-a0b7-d4813412e1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.401400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aae5-e5bb-4a32-a0b7-d4813412e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.401681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aae5-e5bb-4a32-a0b7-d4813412e1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.402384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734aae5-e5bb-4a32-a0b7-d4813412e1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.404760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734aae5-e5bb-4a32-a0b7-d4813412e1f1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:51.428940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:51.458126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 831/1644] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:51 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:51.463113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611343ce-4f54-47a7-b7dd-5b7c9cb98286 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.490163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611343ce-4f54-47a7-b7dd-5b7c9cb98286 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:51.614910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7aba19-f8f3-4e11-a6b6-c1599897bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.616006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aba19-f8f3-4e11-a6b6-c1599897bc06 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.616510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aba19-f8f3-4e11-a6b6-c1599897bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.617857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aba19-f8f3-4e11-a6b6-c1599897bc06 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.620152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7aba19-f8f3-4e11-a6b6-c1599897bc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.626528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7aba19-f8f3-4e11-a6b6-c1599897bc06 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:51.696810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 814/1645] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:51 2022] POST /identity/v3/users => generated 309 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:51.698166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734aae5-e5bb-4a32-a0b7-d4813412e1f1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.736922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734aae5-e5bb-4a32-a0b7-d4813412e1f1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:51.753220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12997821-7837-41a8-8640-058ab39cbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.754840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12997821-7837-41a8-8640-058ab39cbe41 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.757641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12997821-7837-41a8-8640-058ab39cbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.758692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12997821-7837-41a8-8640-058ab39cbe41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.760067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12997821-7837-41a8-8640-058ab39cbe41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.762964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12997821-7837-41a8-8640-058ab39cbe41 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:51.798064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 832/1646] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:51.803910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7aba19-f8f3-4e11-a6b6-c1599897bc06 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.867234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7aba19-f8f3-4e11-a6b6-c1599897bc06 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:51.893442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2a64-a50e-40b7-ba5c-6c9ad766fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.895138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2a64-a50e-40b7-ba5c-6c9ad766fb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.895686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2a64-a50e-40b7-ba5c-6c9ad766fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.896346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2a64-a50e-40b7-ba5c-6c9ad766fb75 admin admin] PATH_INFO: `/v3/projects/f936bff93700480eba74363537433c24/users/c2d5a74c37c247629b49d74b17e22662/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.985643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d2a64-a50e-40b7-ba5c-6c9ad766fb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f936bff93700480eba74363537433c24, user_id=c2d5a74c37c247629b49d74b17e22662, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.991145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d2a64-a50e-40b7-ba5c-6c9ad766fb75 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:52.046855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 815/1647] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:51 2022] PUT /identity/v3/projects/f936bff93700480eba74363537433c24/users/c2d5a74c37c247629b49d74b17e22662/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:52.050919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12997821-7837-41a8-8640-058ab39cbe41 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:52.075566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12997821-7837-41a8-8640-058ab39cbe41 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:52.263088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:52.263804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.264093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.264372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.265041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:52.266763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:52.292807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 833/1648] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:52.296412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2a64-a50e-40b7-ba5c-6c9ad766fb75 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:52.314165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2a64-a50e-40b7-ba5c-6c9ad766fb75 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:52.349284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dab75-c1ad-486d-97ea-ac679accef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:52.354578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dab75-c1ad-486d-97ea-ac679accef08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.355749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dab75-c1ad-486d-97ea-ac679accef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.356517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dab75-c1ad-486d-97ea-ac679accef08 admin admin] PATH_INFO: `/v3/projects/f936bff93700480eba74363537433c24/users/c2d5a74c37c247629b49d74b17e22662/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.369855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dab75-c1ad-486d-97ea-ac679accef08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f936bff93700480eba74363537433c24, user_id=c2d5a74c37c247629b49d74b17e22662, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:52.375022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dab75-c1ad-486d-97ea-ac679accef08 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:52.403591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 816/1649] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:52 2022] PUT /identity/v3/projects/f936bff93700480eba74363537433c24/users/c2d5a74c37c247629b49d74b17e22662/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:52.788658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:52.795191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:52.865448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02888d1-d09b-40cd-9b2e-10fb19f93f88 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:53.259217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:53.260805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.262015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.262015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] PATH_INFO: `/v3/projects/fc1b2d8410c24838992be4ea0d1667db` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.267258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1b2d8410c24838992be4ea0d1667db)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:53.271634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:53.444933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1b2d8410c24838992be4ea0d1667db', 'request_id': 'req-cdcfebac-a5c3-45cb-afcd-af342a444db1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.474229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1b2d8410c24838992be4ea0d1667db', 'request_id': 'req-cdcfebac-a5c3-45cb-afcd-af342a444db1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.502352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1b2d8410c24838992be4ea0d1667db', 'request_id': 'req-cdcfebac-a5c3-45cb-afcd-af342a444db1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.558912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] The token cache is being invalidate because project fc1b2d8410c24838992be4ea0d1667db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:53.559489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.565956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.568753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 834/1650] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:52 2022] DELETE /identity/v3/projects/fc1b2d8410c24838992be4ea0d1667db => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:53.578205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533102f-9475-41ab-a22c-3899e06cef2e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.578766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533102f-9475-41ab-a22c-3899e06cef2e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.579441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533102f-9475-41ab-a22c-3899e06cef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.640140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:53.642074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:53.649980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a533102f-9475-41ab-a22c-3899e06cef2e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:53.653086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a533102f-9475-41ab-a22c-3899e06cef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:53.670090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:53.843039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfebac-a5c3-45cb-afcd-af342a444db1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:53.862873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:53.866562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.866874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.867124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] PATH_INFO: `/v3/projects/60ad47f23a454aa8a024cbbe879b2a94` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.870144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ad47f23a454aa8a024cbbe879b2a94)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:53.890251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:53.890711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 817/1651] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:53.896387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c59c8-4861-4cb2-bf6d-82a28b9bd719 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.896680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c59c8-4861-4cb2-bf6d-82a28b9bd719 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.896947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c59c8-4861-4cb2-bf6d-82a28b9bd719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.987560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1e8c59c8-4861-4cb2-bf6d-82a28b9bd719 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:53.988933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1e8c59c8-4861-4cb2-bf6d-82a28b9bd719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:54.022576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 818/1652] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:54.023763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c59c8-4861-4cb2-bf6d-82a28b9bd719 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.046763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c59c8-4861-4cb2-bf6d-82a28b9bd719 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:54.057221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ad47f23a454aa8a024cbbe879b2a94', 'request_id': 'req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.069443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ad47f23a454aa8a024cbbe879b2a94', 'request_id': 'req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.092891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ad47f23a454aa8a024cbbe879b2a94', 'request_id': 'req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.129272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] The token cache is being invalidate because project 60ad47f23a454aa8a024cbbe879b2a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:54.129725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.134366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.139221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 835/1653] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:53 2022] DELETE /identity/v3/projects/60ad47f23a454aa8a024cbbe879b2a94 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:54.143993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.148912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:54.151347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:54.299221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:54.300339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.300864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.309756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.311171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:54.311717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.325722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:54.398986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 819/1654] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:15:54.406103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.414127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:54.464082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d8b44-d2a8-4781-b807-84a4d83464f4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:54.480735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc172f-3911-4e3e-bc76-3d67c675f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:54.481386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc172f-3911-4e3e-bc76-3d67c675f3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.484064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc172f-3911-4e3e-bc76-3d67c675f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.484361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc172f-3911-4e3e-bc76-3d67c675f3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.485120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc172f-3911-4e3e-bc76-3d67c675f3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.494808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc172f-3911-4e3e-bc76-3d67c675f3c0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:54.534858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9338f-0b6d-47c7-a744-6d2218cf6fa7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:54.559450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:54.560591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.561110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.563597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] PATH_INFO: `/v3/users/b406ef7f7b634cc8a7e4806f817d75e7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.586223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b406ef7f7b634cc8a7e4806f817d75e7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.591325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 820/1655] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:54 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:15:54.593634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc172f-3911-4e3e-bc76-3d67c675f3c0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.596477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:54.734619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:54.741906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b406ef7f7b634cc8a7e4806f817d75e7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.764355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc172f-3911-4e3e-bc76-3d67c675f3c0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:54.765072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b406ef7f7b634cc8a7e4806f817d75e7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.766012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b406ef7f7b634cc8a7e4806f817d75e7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.780977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d48a3-f6f7-47c8-b63d-651c60ac2737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:54.782151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d48a3-f6f7-47c8-b63d-651c60ac2737 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.782674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d48a3-f6f7-47c8-b63d-651c60ac2737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.782958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d48a3-f6f7-47c8-b63d-651c60ac2737 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.784498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d48a3-f6f7-47c8-b63d-651c60ac2737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.789108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b406ef7f7b634cc8a7e4806f817d75e7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.790125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b406ef7f7b634cc8a7e4806f817d75e7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:54.798083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d48a3-f6f7-47c8-b63d-651c60ac2737 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:54.838800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 836/1656] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:54 2022] DELETE /identity/v3/users/b406ef7f7b634cc8a7e4806f817d75e7 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:54.857395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 821/1657] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:54 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:15:54.863479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.866122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:54.986734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fdec4-735c-4e3d-862e-f2c28161f4fe admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:55.003207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2096b-ae02-4aa7-9242-a14dd1f20290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:55.004798 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2096b-ae02-4aa7-9242-a14dd1f20290 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:55.005970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2096b-ae02-4aa7-9242-a14dd1f20290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:55.006770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2096b-ae02-4aa7-9242-a14dd1f20290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:55.008552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2096b-ae02-4aa7-9242-a14dd1f20290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:55.013240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2096b-ae02-4aa7-9242-a14dd1f20290 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:55.051482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 837/1658] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:55.054770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d48a3-f6f7-47c8-b63d-651c60ac2737 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:55.121555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d48a3-f6f7-47c8-b63d-651c60ac2737 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:55.137215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170410-6490-4b3f-9c39-d0b9dfd422f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:55.139956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170410-6490-4b3f-9c39-d0b9dfd422f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:55.140766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170410-6490-4b3f-9c39-d0b9dfd422f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:55.141551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170410-6490-4b3f-9c39-d0b9dfd422f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:55.144028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7170410-6490-4b3f-9c39-d0b9dfd422f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:55.154869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7170410-6490-4b3f-9c39-d0b9dfd422f6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:55.191030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 822/1659] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:15:55.198173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2096b-ae02-4aa7-9242-a14dd1f20290 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:55.216013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2096b-ae02-4aa7-9242-a14dd1f20290 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:55.241198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1591a-c9ba-4e4f-bc27-290008ca2d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:55.251840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1591a-c9ba-4e4f-bc27-290008ca2d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:55.253925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1591a-c9ba-4e4f-bc27-290008ca2d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:55.262717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1591a-c9ba-4e4f-bc27-290008ca2d28 admin admin] PATH_INFO: `/v3/projects/8bf41e81021d4a728f331e8a12468704/users/259b34cc6f5b4d688563c34dc8046bd1/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:55.408558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1591a-c9ba-4e4f-bc27-290008ca2d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf41e81021d4a728f331e8a12468704, user_id=259b34cc6f5b4d688563c34dc8046bd1, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:55.415189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1591a-c9ba-4e4f-bc27-290008ca2d28 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:55.495838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 838/1660] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:55 2022] PUT /identity/v3/projects/8bf41e81021d4a728f331e8a12468704/users/259b34cc6f5b4d688563c34dc8046bd1/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:15:55.522151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623abca4-1d53-4745-961f-2824b4c3bb8e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:55.524650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623abca4-1d53-4745-961f-2824b4c3bb8e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:55.540309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623abca4-1d53-4745-961f-2824b4c3bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:55.665741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-623abca4-1d53-4745-961f-2824b4c3bb8e None None] MFA Rules not processed for user `259b34cc6f5b4d688563c34dc8046bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:55.668373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-623abca4-1d53-4745-961f-2824b4c3bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:55.773334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 823/1661] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:55.781220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1591a-c9ba-4e4f-bc27-290008ca2d28 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.067995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1591a-c9ba-4e4f-bc27-290008ca2d28 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.077475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d01a4-1b66-4534-b879-da1e17777347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.080379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d01a4-1b66-4534-b879-da1e17777347 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.080775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d01a4-1b66-4534-b879-da1e17777347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.081400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d01a4-1b66-4534-b879-da1e17777347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.083255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d01a4-1b66-4534-b879-da1e17777347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.087096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d01a4-1b66-4534-b879-da1e17777347 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.222318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 839/1662] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:55 2022] POST /identity/v3/projects => generated 367 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:15:56.227684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623abca4-1d53-4745-961f-2824b4c3bb8e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.241091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623abca4-1d53-4745-961f-2824b4c3bb8e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.253146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:56.334055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efee63-72da-4624-86e4-009e8f29f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.334996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efee63-72da-4624-86e4-009e8f29f173 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.335880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efee63-72da-4624-86e4-009e8f29f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.336190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efee63-72da-4624-86e4-009e8f29f173 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.336882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efee63-72da-4624-86e4-009e8f29f173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.340506 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efee63-72da-4624-86e4-009e8f29f173 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.379095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 824/1663] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:56 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:56.383982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d01a4-1b66-4534-b879-da1e17777347 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.404501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d01a4-1b66-4534-b879-da1e17777347 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.430305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae053-b247-454e-9218-a17028031f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.435216 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae053-b247-454e-9218-a17028031f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.435474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae053-b247-454e-9218-a17028031f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.445374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae053-b247-454e-9218-a17028031f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.447117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae053-b247-454e-9218-a17028031f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.449366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae053-b247-454e-9218-a17028031f92 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.479703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 840/1664] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:56.482305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efee63-72da-4624-86e4-009e8f29f173 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.497921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efee63-72da-4624-86e4-009e8f29f173 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.504439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4e266-067e-4ec5-9269-39f92e5cc923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.505418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e266-067e-4ec5-9269-39f92e5cc923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.505863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e266-067e-4ec5-9269-39f92e5cc923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.506154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e266-067e-4ec5-9269-39f92e5cc923 admin admin] PATH_INFO: `/v3/projects/88f19a347e714364a000236c1abf2c6f/users/2c6e35f8b26c46f39d585d0edb2601d1/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.531339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4e266-067e-4ec5-9269-39f92e5cc923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f19a347e714364a000236c1abf2c6f, user_id=2c6e35f8b26c46f39d585d0edb2601d1, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.535776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4e266-067e-4ec5-9269-39f92e5cc923 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.568109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae053-b247-454e-9218-a17028031f92 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.573726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 825/1665] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:56 2022] PUT /identity/v3/projects/88f19a347e714364a000236c1abf2c6f/users/2c6e35f8b26c46f39d585d0edb2601d1/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:56.581062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae053-b247-454e-9218-a17028031f92 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.587221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:56.784995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419df9-9d75-4740-b69f-72094416746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.786140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419df9-9d75-4740-b69f-72094416746d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.787052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419df9-9d75-4740-b69f-72094416746d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.787393 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419df9-9d75-4740-b69f-72094416746d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.788716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419df9-9d75-4740-b69f-72094416746d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.793580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419df9-9d75-4740-b69f-72094416746d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.847425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4e266-067e-4ec5-9269-39f92e5cc923 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.851618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 841/1666] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:56.874031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4e266-067e-4ec5-9269-39f92e5cc923 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.898459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.899987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.900485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.900989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] PATH_INFO: `/v3/projects/88f19a347e714364a000236c1abf2c6f/users/2c6e35f8b26c46f39d585d0edb2601d1/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.905492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f19a347e714364a000236c1abf2c6f, user_id=2c6e35f8b26c46f39d585d0edb2601d1, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.912076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.972614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230dddb-a70f-4d4a-aadf-688f066e42d6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.974760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230dddb-a70f-4d4a-aadf-688f066e42d6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.975410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230dddb-a70f-4d4a-aadf-688f066e42d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.988640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 826/1667] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:56 2022] PUT /identity/v3/projects/88f19a347e714364a000236c1abf2c6f/users/2c6e35f8b26c46f39d585d0edb2601d1/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:57.127883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9230dddb-a70f-4d4a-aadf-688f066e42d6 None None] MFA Rules not processed for user `2c6e35f8b26c46f39d585d0edb2601d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:57.135388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9230dddb-a70f-4d4a-aadf-688f066e42d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:57.407344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 842/1668] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:57.416164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:57.421302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:57.774172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41880f0-9e57-446b-bfa0-724eda99c24f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:57.796613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1250a9-82ac-46ce-b571-cac6beb82cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:57.797713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1250a9-82ac-46ce-b571-cac6beb82cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:57.798313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1250a9-82ac-46ce-b571-cac6beb82cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:57.798787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1250a9-82ac-46ce-b571-cac6beb82cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:57.841373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1250a9-82ac-46ce-b571-cac6beb82cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:57.844467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1250a9-82ac-46ce-b571-cac6beb82cb6 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:57.892711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230dddb-a70f-4d4a-aadf-688f066e42d6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:57.896444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9230dddb-a70f-4d4a-aadf-688f066e42d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:57.947082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 827/1669] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:58.078501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf3c1-7a84-4d5f-aa3c-feabcd29f9f2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.078926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf3c1-7a84-4d5f-aa3c-feabcd29f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.079456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf3c1-7a84-4d5f-aa3c-feabcd29f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.189061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230dddb-a70f-4d4a-aadf-688f066e42d6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:58.214023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:58.214918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.215311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.215695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] PATH_INFO: `/v3/projects/668c11e61f7845bb9e5ea25feb9a542b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.218457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=668c11e61f7845bb9e5ea25feb9a542b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:58.228663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:58.276320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-016bf3c1-7a84-4d5f-aa3c-feabcd29f9f2 None None] MFA Rules not processed for user `c2d5a74c37c247629b49d74b17e22662`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:58.282486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-016bf3c1-7a84-4d5f-aa3c-feabcd29f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:58.338987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:58.382420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668c11e61f7845bb9e5ea25feb9a542b', 'request_id': 'req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.408147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668c11e61f7845bb9e5ea25feb9a542b', 'request_id': 'req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.429580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668c11e61f7845bb9e5ea25feb9a542b', 'request_id': 'req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.468750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] The token cache is being invalidate because project 668c11e61f7845bb9e5ea25feb9a542b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:58.469146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.471753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a1ba2a0b-a414-4857-8065-41f6f6e8f05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.477647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 843/1670] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:57 2022] DELETE /identity/v3/projects/668c11e61f7845bb9e5ea25feb9a542b => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:15:58.479612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41bec-047b-4563-af0e-4d325a81d63a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.480039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41bec-047b-4563-af0e-4d325a81d63a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.480608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b41bec-047b-4563-af0e-4d325a81d63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.530132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-31b41bec-047b-4563-af0e-4d325a81d63a None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:58.535023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-31b41bec-047b-4563-af0e-4d325a81d63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:58.658148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:58.700356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 828/1671] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:58 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 624 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:58.726397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 844/1672] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:58.742864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a209-0080-416d-a218-db514bf7d432 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.743361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a209-0080-416d-a218-db514bf7d432 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.744406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a209-0080-416d-a218-db514bf7d432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.811344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bca1a209-0080-416d-a218-db514bf7d432 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:58.815451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bca1a209-0080-416d-a218-db514bf7d432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:58.835398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 829/1673] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:58.838125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b41bec-047b-4563-af0e-4d325a81d63a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:58.860321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b41bec-047b-4563-af0e-4d325a81d63a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:58.878948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:58.880553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.880882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.881263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.882235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:58.885921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:58.888057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:58.934806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 845/1674] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:58.936232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1a209-0080-416d-a218-db514bf7d432 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:58.962919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1a209-0080-416d-a218-db514bf7d432 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:58.969659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:58.970357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.970700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.970982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.971760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:58.974832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:59.088837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 830/1675] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:58 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:15:59.090123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.107857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e025ab-b55c-42c3-a0e1-3321031cfe2a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.154053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.156061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.364696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dec3d-4921-4bc2-91be-6a8fdaf2038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:59.367998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dec3d-4921-4bc2-91be-6a8fdaf2038e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.368329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dec3d-4921-4bc2-91be-6a8fdaf2038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.368685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dec3d-4921-4bc2-91be-6a8fdaf2038e admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.372513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dec3d-4921-4bc2-91be-6a8fdaf2038e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:59.377704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dec3d-4921-4bc2-91be-6a8fdaf2038e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:59.412200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198d7ed-68f9-4d7b-9303-1da1a70f6dd3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.420078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:59.420944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.421346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.421729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] PATH_INFO: `/v3/users/cc8ef450fa994dd2a17d1815750f5dd3` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.423360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8ef450fa994dd2a17d1815750f5dd3)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:59.426239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:59.449801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 846/1676] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:59 2022] POST /identity/v3/users => generated 295 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:59.454839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dec3d-4921-4bc2-91be-6a8fdaf2038e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.480266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dec3d-4921-4bc2-91be-6a8fdaf2038e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.496274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b098d-dac6-4640-a9d8-ec620da36b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:59.497523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b098d-dac6-4640-a9d8-ec620da36b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.497814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b098d-dac6-4640-a9d8-ec620da36b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.498092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b098d-dac6-4640-a9d8-ec620da36b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.498925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b098d-dac6-4640-a9d8-ec620da36b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:59.500645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b098d-dac6-4640-a9d8-ec620da36b66 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:59.553777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 847/1677] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:15:59.558733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b098d-dac6-4640-a9d8-ec620da36b66 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.570129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8ef450fa994dd2a17d1815750f5dd3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.588148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8ef450fa994dd2a17d1815750f5dd3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.591929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8ef450fa994dd2a17d1815750f5dd3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.603214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b098d-dac6-4640-a9d8-ec620da36b66 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.615763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8ef450fa994dd2a17d1815750f5dd3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.628184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:59.629554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.631099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.634419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.636003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:59.641512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4764b8dc-2bbd-4998-bf38-bd69bc00c8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8ef450fa994dd2a17d1815750f5dd3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.644017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:59.654762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 831/1678] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:59 2022] DELETE /identity/v3/users/cc8ef450fa994dd2a17d1815750f5dd3 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:15:59.661584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598cb4e-c577-450b-94dc-c894d41a1780 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.661836 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598cb4e-c577-450b-94dc-c894d41a1780 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.662115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598cb4e-c577-450b-94dc-c894d41a1780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.707244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 848/1679] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:59.710396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.715173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e598cb4e-c577-450b-94dc-c894d41a1780 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:59.716465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e598cb4e-c577-450b-94dc-c894d41a1780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.734668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.786852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7ad6b-efed-442c-9476-201b0274f96e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.828637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:59.830646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:59.869646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 832/1680] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:59.967136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598cb4e-c577-450b-94dc-c894d41a1780 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.969425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e598cb4e-c577-450b-94dc-c894d41a1780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:00.007287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99902bc1-97e0-44a3-92fb-c7d178c3ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.014246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902bc1-97e0-44a3-92fb-c7d178c3ede3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.015197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902bc1-97e0-44a3-92fb-c7d178c3ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.018973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99902bc1-97e0-44a3-92fb-c7d178c3ede3 admin admin] PATH_INFO: `/v3/projects/8a801fa3022e4356baa56fa29b84c0d4/users/295ed67ee9ec4a86a5d250ce4a0a02f8/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.059727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598cb4e-c577-450b-94dc-c894d41a1780 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.064192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1bb31-c998-42d0-bf57-85e12b63da91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.064845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1bb31-c998-42d0-bf57-85e12b63da91 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.065186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1bb31-c998-42d0-bf57-85e12b63da91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.065473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1bb31-c998-42d0-bf57-85e12b63da91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.080019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99902bc1-97e0-44a3-92fb-c7d178c3ede3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a801fa3022e4356baa56fa29b84c0d4, user_id=295ed67ee9ec4a86a5d250ce4a0a02f8, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.087059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99902bc1-97e0-44a3-92fb-c7d178c3ede3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.091817 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1bb31-c998-42d0-bf57-85e12b63da91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.100213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1bb31-c998-42d0-bf57-85e12b63da91 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.113354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 833/1681] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:00.116114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 849/1682] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:59 2022] PUT /identity/v3/projects/8a801fa3022e4356baa56fa29b84c0d4/users/295ed67ee9ec4a86a5d250ce4a0a02f8/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:00.138296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014d26-7225-4ab7-9f3b-ff4573227b0d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.138898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014d26-7225-4ab7-9f3b-ff4573227b0d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.139323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014d26-7225-4ab7-9f3b-ff4573227b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.224975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-15014d26-7225-4ab7-9f3b-ff4573227b0d None None] MFA Rules not processed for user `295ed67ee9ec4a86a5d250ce4a0a02f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:00.230024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-15014d26-7225-4ab7-9f3b-ff4573227b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:00.447257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 834/1683] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:00.454065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99902bc1-97e0-44a3-92fb-c7d178c3ede3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.710628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99902bc1-97e0-44a3-92fb-c7d178c3ede3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.731462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d7fa4-263b-44ea-af61-7bc97a251cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.732879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d7fa4-263b-44ea-af61-7bc97a251cef admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.733524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d7fa4-263b-44ea-af61-7bc97a251cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.734299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d7fa4-263b-44ea-af61-7bc97a251cef admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.735479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d7fa4-263b-44ea-af61-7bc97a251cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.743175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d7fa4-263b-44ea-af61-7bc97a251cef admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.887708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 850/1684] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:00 2022] POST /identity/v3/projects => generated 387 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:00.888683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15014d26-7225-4ab7-9f3b-ff4573227b0d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.965760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15014d26-7225-4ab7-9f3b-ff4573227b0d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.266293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fa6f7-ad10-4507-9623-18875eaf9d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.268823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fa6f7-ad10-4507-9623-18875eaf9d56 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.271534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fa6f7-ad10-4507-9623-18875eaf9d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.272178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fa6f7-ad10-4507-9623-18875eaf9d56 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.279164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fa6f7-ad10-4507-9623-18875eaf9d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.283874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fa6f7-ad10-4507-9623-18875eaf9d56 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.379459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d7fa4-263b-44ea-af61-7bc97a251cef admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.381143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 835/1685] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:00 2022] POST /identity/v3/users => generated 300 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:01.405725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccade03-c6dc-488b-9381-43339c30ffbf None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.407910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccade03-c6dc-488b-9381-43339c30ffbf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.408716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccade03-c6dc-488b-9381-43339c30ffbf None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.416736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d7fa4-263b-44ea-af61-7bc97a251cef admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.422749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 836/1686] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 08:16:01 2022] GET /identity => generated 270 bytes in 35 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:16:01.442991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324353f7-20ab-4d46-aa3a-73fd4a14a54c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.443593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324353f7-20ab-4d46-aa3a-73fd4a14a54c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.444016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324353f7-20ab-4d46-aa3a-73fd4a14a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.453125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab39b6-f54d-4ea3-86ed-3a3c284f0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.455036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab39b6-f54d-4ea3-86ed-3a3c284f0715 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.456490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab39b6-f54d-4ea3-86ed-3a3c284f0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.457289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab39b6-f54d-4ea3-86ed-3a3c284f0715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.459500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab39b6-f54d-4ea3-86ed-3a3c284f0715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.478010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab39b6-f54d-4ea3-86ed-3a3c284f0715 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.514523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:01.524878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 851/1687] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:01.526946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-324353f7-20ab-4d46-aa3a-73fd4a14a54c None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:01.528303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-324353f7-20ab-4d46-aa3a-73fd4a14a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.529763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab39b6-f54d-4ea3-86ed-3a3c284f0715 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.544210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab39b6-f54d-4ea3-86ed-3a3c284f0715 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.552191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b125-fb00-4b15-be9f-022fb3f8f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.553069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b125-fb00-4b15-be9f-022fb3f8f204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.553420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b125-fb00-4b15-be9f-022fb3f8f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.553798 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b125-fb00-4b15-be9f-022fb3f8f204 admin admin] PATH_INFO: `/v3/projects/0c7ba9e37e8e459a970738a4092186e9/users/a484a0b6255140fdaa66b9d5b81dbda6/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.594059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583b125-fb00-4b15-be9f-022fb3f8f204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7ba9e37e8e459a970738a4092186e9, user_id=a484a0b6255140fdaa66b9d5b81dbda6, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.596892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583b125-fb00-4b15-be9f-022fb3f8f204 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.649034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 852/1688] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:01 2022] PUT /identity/v3/projects/0c7ba9e37e8e459a970738a4092186e9/users/a484a0b6255140fdaa66b9d5b81dbda6/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:01.654304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b125-fb00-4b15-be9f-022fb3f8f204 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.734038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 837/1689] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 08:16:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:01.815612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324353f7-20ab-4d46-aa3a-73fd4a14a54c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.816142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:01.819926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-324353f7-20ab-4d46-aa3a-73fd4a14a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.851109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324353f7-20ab-4d46-aa3a-73fd4a14a54c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.866371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b125-fb00-4b15-be9f-022fb3f8f204 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.881452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb3951-73ed-414c-b164-8eea71ff9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.882097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3951-73ed-414c-b164-8eea71ff9d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.882411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3951-73ed-414c-b164-8eea71ff9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.884854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3951-73ed-414c-b164-8eea71ff9d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.885624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb3951-73ed-414c-b164-8eea71ff9d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.890059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb3951-73ed-414c-b164-8eea71ff9d91 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.931441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 853/1690] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:01.936405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb3951-73ed-414c-b164-8eea71ff9d91 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.957162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb3951-73ed-414c-b164-8eea71ff9d91 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.977689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a06e8b-a8a5-4cad-840b-46059b82a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.978406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06e8b-a8a5-4cad-840b-46059b82a918 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.978703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06e8b-a8a5-4cad-840b-46059b82a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.978992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06e8b-a8a5-4cad-840b-46059b82a918 admin admin] PATH_INFO: `/v3/projects/0c7ba9e37e8e459a970738a4092186e9/users/a484a0b6255140fdaa66b9d5b81dbda6/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.991404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a06e8b-a8a5-4cad-840b-46059b82a918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7ba9e37e8e459a970738a4092186e9, user_id=a484a0b6255140fdaa66b9d5b81dbda6, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.994643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a06e8b-a8a5-4cad-840b-46059b82a918 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.032721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 854/1691] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:01 2022] PUT /identity/v3/projects/0c7ba9e37e8e459a970738a4092186e9/users/a484a0b6255140fdaa66b9d5b81dbda6/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:02.055552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b810fdf-1960-4ea2-9345-435ac2f7b6f5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.055889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b810fdf-1960-4ea2-9345-435ac2f7b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.056159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b810fdf-1960-4ea2-9345-435ac2f7b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.063126 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.063960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.064247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.064525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.102547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.105065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.150790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1b810fdf-1960-4ea2-9345-435ac2f7b6f5 None None] MFA Rules not processed for user `a484a0b6255140fdaa66b9d5b81dbda6`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:02.152456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1b810fdf-1960-4ea2-9345-435ac2f7b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.174856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 838/1692] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:02.300701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 855/1693] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:02.320939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.323266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.531647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35693dbc-9a0e-4ae0-b617-47394d630943 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.713644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:02.734447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.737954 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.738156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.739846 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.794453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.820986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.891452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 839/1694] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:02.895927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b810fdf-1960-4ea2-9345-435ac2f7b6f5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.898823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1b810fdf-1960-4ea2-9345-435ac2f7b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.933366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.935449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.076227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b810fdf-1960-4ea2-9345-435ac2f7b6f5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:03.090546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.091678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.092214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.092815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] PATH_INFO: `/v3/projects/5659ecaff9de446cbf9c79f301c0b994` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.095740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5659ecaff9de446cbf9c79f301c0b994)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.104094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:03.261885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766264b-0aa6-486d-9cff-3ffbdae77746 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:03.297568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.298799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.299296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.299799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] PATH_INFO: `/v3/users/259b34cc6f5b4d688563c34dc8046bd1` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.311317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259b34cc6f5b4d688563c34dc8046bd1)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.319565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:03.361964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5659ecaff9de446cbf9c79f301c0b994', 'request_id': 'req-394df528-54e4-4c83-bfc4-f8d73283994c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.381732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5659ecaff9de446cbf9c79f301c0b994', 'request_id': 'req-394df528-54e4-4c83-bfc4-f8d73283994c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.387623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:03.395965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5659ecaff9de446cbf9c79f301c0b994', 'request_id': 'req-394df528-54e4-4c83-bfc4-f8d73283994c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.422242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] The token cache is being invalidate because project 5659ecaff9de446cbf9c79f301c0b994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:03.422684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.427514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-394df528-54e4-4c83-bfc4-f8d73283994c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.432041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 856/1695] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:02 2022] DELETE /identity/v3/projects/5659ecaff9de446cbf9c79f301c0b994 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:03.434142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f577-a52c-4694-a022-e4b8b37aa881 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.434486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f577-a52c-4694-a022-e4b8b37aa881 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.434837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f577-a52c-4694-a022-e4b8b37aa881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.530480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6cb5f577-a52c-4694-a022-e4b8b37aa881 None None] MFA Rules not processed for user `854e77042ee14f7f806a33f9c9501bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:03.531763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6cb5f577-a52c-4694-a022-e4b8b37aa881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.531873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259b34cc6f5b4d688563c34dc8046bd1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.557981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259b34cc6f5b4d688563c34dc8046bd1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.559911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259b34cc6f5b4d688563c34dc8046bd1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.587967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259b34cc6f5b4d688563c34dc8046bd1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.642226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259b34cc6f5b4d688563c34dc8046bd1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.659753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 840/1696] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:02 2022] DELETE /identity/v3/users/259b34cc6f5b4d688563c34dc8046bd1 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:03.661372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:03.668391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.726327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 857/1697] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:03.735457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26777d3e-da0a-4934-a8c1-75715f34f84d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.735457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26777d3e-da0a-4934-a8c1-75715f34f84d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.735457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26777d3e-da0a-4934-a8c1-75715f34f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.785336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-26777d3e-da0a-4934-a8c1-75715f34f84d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:03.786944 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-26777d3e-da0a-4934-a8c1-75715f34f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.948949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b3dcd-21ec-4042-aacb-83693423a234 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:03.951877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 858/1698] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:03.953375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6283-2068-454a-a79e-f84db0bf61e2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.953662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6283-2068-454a-a79e-f84db0bf61e2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.953943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6283-2068-454a-a79e-f84db0bf61e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.970923 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.972213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.973343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.974579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] PATH_INFO: `/v3/users/295ed67ee9ec4a86a5d250ce4a0a02f8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.990845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] RBAC: Authorizing `identity:delete_user(user_id=295ed67ee9ec4a86a5d250ce4a0a02f8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.996411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b42e6283-2068-454a-a79e-f84db0bf61e2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:03.997688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b42e6283-2068-454a-a79e-f84db0bf61e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.007153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.019245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 859/1699] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:04.020746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d802217-b5c4-4b65-a75f-128441304174 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.021124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d802217-b5c4-4b65-a75f-128441304174 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.021530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d802217-b5c4-4b65-a75f-128441304174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.054696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:04.077142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2d802217-b5c4-4b65-a75f-128441304174 None None] MFA Rules not processed for user `854e77042ee14f7f806a33f9c9501bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:04.083800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2d802217-b5c4-4b65-a75f-128441304174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.121298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295ed67ee9ec4a86a5d250ce4a0a02f8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.142891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295ed67ee9ec4a86a5d250ce4a0a02f8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.144472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295ed67ee9ec4a86a5d250ce4a0a02f8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.163127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295ed67ee9ec4a86a5d250ce4a0a02f8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.208007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-25ca81ed-4552-4dcf-bbd0-cac26d2d257e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295ed67ee9ec4a86a5d250ce4a0a02f8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.221248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 841/1700] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:03 2022] DELETE /identity/v3/users/295ed67ee9ec4a86a5d250ce4a0a02f8 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:04.226786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1bc3-0cf8-442c-8780-565ba0f57a81 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.227369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1bc3-0cf8-442c-8780-565ba0f57a81 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.227892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1bc3-0cf8-442c-8780-565ba0f57a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.254105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 860/1701] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:04.256985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d1987-3aac-4c84-9e07-0126d78ba50e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.258461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d1987-3aac-4c84-9e07-0126d78ba50e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.258869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d1987-3aac-4c84-9e07-0126d78ba50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.259708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2e8c1bc3-0cf8-442c-8780-565ba0f57a81 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:04.261324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2e8c1bc3-0cf8-442c-8780-565ba0f57a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.346930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:04.354789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b29d1987-3aac-4c84-9e07-0126d78ba50e None None] MFA Rules not processed for user `c5d55971cbce4c61a81b158aa666e2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:04.358789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b29d1987-3aac-4c84-9e07-0126d78ba50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.457261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 842/1702] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:04.459431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c1bc3-0cf8-442c-8780-565ba0f57a81 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.463343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2e8c1bc3-0cf8-442c-8780-565ba0f57a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.538174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 861/1703] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:04.554428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9241af-496c-49f7-a78f-6ee527742b86 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.557358 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9241af-496c-49f7-a78f-6ee527742b86 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.558304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9241af-496c-49f7-a78f-6ee527742b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.628338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2e9241af-496c-49f7-a78f-6ee527742b86 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:04.630206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2e9241af-496c-49f7-a78f-6ee527742b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.651418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 862/1704] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:04.652470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9241af-496c-49f7-a78f-6ee527742b86 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.653959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2e9241af-496c-49f7-a78f-6ee527742b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.674998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c1bc3-0cf8-442c-8780-565ba0f57a81 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.691501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.692744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.693124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.693421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.704883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.749507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.750459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.789557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 843/1705] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:04.794128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.820789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c6765-5cc4-4f9c-ac7a-f4d2cc938c78 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.837751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eb5eb-2e37-48d0-9864-600b9e706650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.838556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb5eb-2e37-48d0-9864-600b9e706650 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.838926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb5eb-2e37-48d0-9864-600b9e706650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.839343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb5eb-2e37-48d0-9864-600b9e706650 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.840238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eb5eb-2e37-48d0-9864-600b9e706650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:04.840805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eb5eb-2e37-48d0-9864-600b9e706650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.842598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eb5eb-2e37-48d0-9864-600b9e706650 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.844850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9241af-496c-49f7-a78f-6ee527742b86 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.880637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.883354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.883958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.884447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.900695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.906742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 844/1706] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:04.906742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39d59f-f413-45e4-ac6e-141781b2caa9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.906742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39d59f-f413-45e4-ac6e-141781b2caa9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.906742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39d59f-f413-45e4-ac6e-141781b2caa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.965690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9f39d59f-f413-45e4-ac6e-141781b2caa9 None None] MFA Rules not processed for user `c5d55971cbce4c61a81b158aa666e2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:04.966974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9f39d59f-f413-45e4-ac6e-141781b2caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.997904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 845/1707] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:04.998607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39d59f-f413-45e4-ac6e-141781b2caa9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.032078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39d59f-f413-45e4-ac6e-141781b2caa9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.051108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.052262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.052545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.052821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.053475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.055492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.082559 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:05.101675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.105328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.132875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 846/1708] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:05.132875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.141740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.146762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 863/1709] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:05.153558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.156189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.203209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924773bc-24f6-494b-839c-fef965039d68 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.325333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:05.336413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a05aa-e97e-45c0-b729-e07d19e5fd7f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.352514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cf1b8-3d7e-4d08-ae35-06925cf6df08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.353201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cf1b8-3d7e-4d08-ae35-06925cf6df08 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.353610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cf1b8-3d7e-4d08-ae35-06925cf6df08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.353956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cf1b8-3d7e-4d08-ae35-06925cf6df08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.453943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccbef5-59a3-4a6f-b64f-eddcf6e4d482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.454661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbef5-59a3-4a6f-b64f-eddcf6e4d482 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.454946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbef5-59a3-4a6f-b64f-eddcf6e4d482 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.455224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbef5-59a3-4a6f-b64f-eddcf6e4d482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.570147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cf1b8-3d7e-4d08-ae35-06925cf6df08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.571652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cf1b8-3d7e-4d08-ae35-06925cf6df08 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.590104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 847/1710] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:05.592866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cf1b8-3d7e-4d08-ae35-06925cf6df08 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.620349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cf1b8-3d7e-4d08-ae35-06925cf6df08 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.620990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccbef5-59a3-4a6f-b64f-eddcf6e4d482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.622691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccbef5-59a3-4a6f-b64f-eddcf6e4d482 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.628677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc880a07-eba3-4ba7-ae08-53b9426a6326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.630043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880a07-eba3-4ba7-ae08-53b9426a6326 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.630700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880a07-eba3-4ba7-ae08-53b9426a6326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.631216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc880a07-eba3-4ba7-ae08-53b9426a6326 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.632031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc880a07-eba3-4ba7-ae08-53b9426a6326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.634982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc880a07-eba3-4ba7-ae08-53b9426a6326 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.658714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 864/1711] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:05.662434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a4d9-72c6-4ab7-b246-c6f9535a6f5c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.662434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a4d9-72c6-4ab7-b246-c6f9535a6f5c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.662434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6a4d9-72c6-4ab7-b246-c6f9535a6f5c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.670724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 865/1712] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 08:16:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:16:05.672113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6a4d9-72c6-4ab7-b246-c6f9535a6f5c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.676011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cdd6a4d9-72c6-4ab7-b246-c6f9535a6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.698682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 848/1713] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:05 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:05.703096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e056c1-b92b-454d-936e-4a07461cacf6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.705226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e056c1-b92b-454d-936e-4a07461cacf6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.706811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e056c1-b92b-454d-936e-4a07461cacf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.743718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6a4d9-72c6-4ab7-b246-c6f9535a6f5c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.759351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.760848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.762873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.764180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] PATH_INFO: `/v3/users/038771ae63ab4206ad78ac1e9b57ed6a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.769212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038771ae63ab4206ad78ac1e9b57ed6a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.774585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.776333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-87e056c1-b92b-454d-936e-4a07461cacf6 None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:05.780109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-87e056c1-b92b-454d-936e-4a07461cacf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.997683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038771ae63ab4206ad78ac1e9b57ed6a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.028790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038771ae63ab4206ad78ac1e9b57ed6a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.031137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038771ae63ab4206ad78ac1e9b57ed6a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.050526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038771ae63ab4206ad78ac1e9b57ed6a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.051243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038771ae63ab4206ad78ac1e9b57ed6a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.091841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 849/1714] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 08:16:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:06.094167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e056c1-b92b-454d-936e-4a07461cacf6 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.098543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-87e056c1-b92b-454d-936e-4a07461cacf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:06.106478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 866/1715] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:05 2022] DELETE /identity/v3/users/038771ae63ab4206ad78ac1e9b57ed6a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:06.122463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e056c1-b92b-454d-936e-4a07461cacf6 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.178515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.180421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:06.221665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:06.299043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:06.348304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfcc1a-60ce-4126-9eff-c0b013dadc38 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.357973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f4491-433f-4f12-aa1c-894ec765ebd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.360005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f4491-433f-4f12-aa1c-894ec765ebd4 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.361406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f4491-433f-4f12-aa1c-894ec765ebd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.361886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f4491-433f-4f12-aa1c-894ec765ebd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.375303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f4491-433f-4f12-aa1c-894ec765ebd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.377747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f4491-433f-4f12-aa1c-894ec765ebd4 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.394222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 867/1716] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:06.462152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee383bce-9df5-41ff-bc6f-10a3571578cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.463483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee383bce-9df5-41ff-bc6f-10a3571578cd admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.465594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee383bce-9df5-41ff-bc6f-10a3571578cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.466405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee383bce-9df5-41ff-bc6f-10a3571578cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.467999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee383bce-9df5-41ff-bc6f-10a3571578cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.473787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee383bce-9df5-41ff-bc6f-10a3571578cd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.536726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 850/1717] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:06.541610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f4491-433f-4f12-aa1c-894ec765ebd4 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.576479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f4491-433f-4f12-aa1c-894ec765ebd4 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.602888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892c013-d15a-4881-a17d-4c959deb6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.604983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c013-d15a-4881-a17d-4c959deb6fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.613837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c013-d15a-4881-a17d-4c959deb6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.618987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892c013-d15a-4881-a17d-4c959deb6fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.623593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892c013-d15a-4881-a17d-4c959deb6fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.651975 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892c013-d15a-4881-a17d-4c959deb6fe7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.704336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 868/1718] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:06.709462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee383bce-9df5-41ff-bc6f-10a3571578cd admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.761052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee383bce-9df5-41ff-bc6f-10a3571578cd admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.791158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791773e-e5cc-4b10-bf32-d0c8fcf3f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.792509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791773e-e5cc-4b10-bf32-d0c8fcf3f00b admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.794854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791773e-e5cc-4b10-bf32-d0c8fcf3f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.795533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791773e-e5cc-4b10-bf32-d0c8fcf3f00b admin admin] PATH_INFO: `/v3/projects/c798be95a56943d6b2855fee7d752fe4/users/34c482d077e849bc9da3ef8d871285f3/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.849649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791773e-e5cc-4b10-bf32-d0c8fcf3f00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c798be95a56943d6b2855fee7d752fe4, user_id=34c482d077e849bc9da3ef8d871285f3, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.853251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791773e-e5cc-4b10-bf32-d0c8fcf3f00b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.904363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 851/1719] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:06 2022] PUT /identity/v3/projects/c798be95a56943d6b2855fee7d752fe4/users/34c482d077e849bc9da3ef8d871285f3/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:06.919863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a09a6-f7fb-402b-8e69-94642edf9f13 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.920648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a09a6-f7fb-402b-8e69-94642edf9f13 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.921207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a09a6-f7fb-402b-8e69-94642edf9f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.104638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-485a09a6-f7fb-402b-8e69-94642edf9f13 None None] MFA Rules not processed for user `34c482d077e849bc9da3ef8d871285f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:07.114131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-485a09a6-f7fb-402b-8e69-94642edf9f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:07.257386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1fcda-60ac-448b-ac12-ccaf5e1a005b None None] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.257700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1fcda-60ac-448b-ac12-ccaf5e1a005b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.258068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1fcda-60ac-448b-ac12-ccaf5e1a005b None None] PATH_INFO: `/` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.259664 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 852/1720] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 08:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:16:07.273144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3314-d231-4fb4-a39f-75bd5f7290bf None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.273399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3314-d231-4fb4-a39f-75bd5f7290bf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.273687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3314-d231-4fb4-a39f-75bd5f7290bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.408710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-660b3314-d231-4fb4-a39f-75bd5f7290bf None None] MFA Rules not processed for user `af3eef42cf30440aaf30f3ddb882fd04`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:07.409636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-660b3314-d231-4fb4-a39f-75bd5f7290bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:07.562325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 869/1721] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 636 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:07.562325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a09a6-f7fb-402b-8e69-94642edf9f13 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:07.562325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-485a09a6-f7fb-402b-8e69-94642edf9f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:07.574026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 853/1722] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:16:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:07.575253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b3314-d231-4fb4-a39f-75bd5f7290bf None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:07.953746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b3314-d231-4fb4-a39f-75bd5f7290bf None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:07.963285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a09a6-f7fb-402b-8e69-94642edf9f13 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:08.000747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:08.006456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.006456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.006456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.007007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:08.009884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:08.013232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:08.013900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.014183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.014845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] PATH_INFO: `/v3/projects/8bf41e81021d4a728f331e8a12468704` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.016589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf41e81021d4a728f331e8a12468704)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:08.020919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:08.080428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 854/1723] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:07 2022] POST /identity/v3/projects => generated 381 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:08.084610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:08.090345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:08.127003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:08.182350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf41e81021d4a728f331e8a12468704', 'request_id': 'req-2d130373-fd09-41fe-84ce-e91e95b62c52'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.191255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:08.202531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf41e81021d4a728f331e8a12468704', 'request_id': 'req-2d130373-fd09-41fe-84ce-e91e95b62c52'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.259255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf41e81021d4a728f331e8a12468704', 'request_id': 'req-2d130373-fd09-41fe-84ce-e91e95b62c52'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.315258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] The token cache is being invalidate because project 8bf41e81021d4a728f331e8a12468704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:08.315258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.318146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.324718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 870/1724] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:07 2022] DELETE /identity/v3/projects/8bf41e81021d4a728f331e8a12468704 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:08.324718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:08.326227 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831566a-8298-4a4f-a4ff-88442b153bfc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:08.328636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:08.489854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d130373-fd09-41fe-84ce-e91e95b62c52 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:08.502948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:08.503812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.504205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.505373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] PATH_INFO: `/v3/projects/0f49f08b993746c6a4a5ce8fab41d35e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.507663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f49f08b993746c6a4a5ce8fab41d35e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:08.509513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: WARNING py.warnings [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:16:08.509513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: warnings.warn(msg) Sep 01 08:16:08.509513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: Sep 01 08:16:08.512038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:08.512999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:08.513857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.514161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.514605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.518671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:08.548765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:08.550492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:08.581656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 871/1725] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:08.583007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:08.589275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:08.645355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17446-eb09-40f9-9411-f2507e602e97 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:08.654906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab57b1-f721-4d7b-8229-15e7a640faad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:08.656493 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab57b1-f721-4d7b-8229-15e7a640faad admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.658287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab57b1-f721-4d7b-8229-15e7a640faad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.659060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab57b1-f721-4d7b-8229-15e7a640faad admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.664182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab57b1-f721-4d7b-8229-15e7a640faad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:08.669364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab57b1-f721-4d7b-8229-15e7a640faad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:08.734965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 872/1726] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:08 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:08.741595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb235-1246-4d60-bf52-d906f22c99bc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.742673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb235-1246-4d60-bf52-d906f22c99bc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.745781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb235-1246-4d60-bf52-d906f22c99bc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.759227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 873/1727] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 08:16:08 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:16:08.764551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb235-1246-4d60-bf52-d906f22c99bc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:08.773340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-011bb235-1246-4d60-bf52-d906f22c99bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:08.798097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f49f08b993746c6a4a5ce8fab41d35e', 'request_id': 'req-c40c4a7d-ccc4-42e5-a790-846b14bea698'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.862320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f49f08b993746c6a4a5ce8fab41d35e', 'request_id': 'req-c40c4a7d-ccc4-42e5-a790-846b14bea698'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.890024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f49f08b993746c6a4a5ce8fab41d35e', 'request_id': 'req-c40c4a7d-ccc4-42e5-a790-846b14bea698'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.907766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] The token cache is being invalidate because project 0f49f08b993746c6a4a5ce8fab41d35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:08.908491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.909423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.913077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 855/1728] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:08 2022] DELETE /identity/v3/projects/0f49f08b993746c6a4a5ce8fab41d35e => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:08.914518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:08.918073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:08.961908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb235-1246-4d60-bf52-d906f22c99bc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:08.985677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:08.997554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.997967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.998323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] PATH_INFO: `/v3/users/2c6e35f8b26c46f39d585d0edb2601d1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.000768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6e35f8b26c46f39d585d0edb2601d1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:09.002818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:09.112217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:09.141340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6e35f8b26c46f39d585d0edb2601d1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.161849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c4a7d-ccc4-42e5-a790-846b14bea698 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:09.170655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6e35f8b26c46f39d585d0edb2601d1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.175621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6e35f8b26c46f39d585d0edb2601d1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.186463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37598ff0-33bd-4a0a-8ecf-3f515c506225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:09.188461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37598ff0-33bd-4a0a-8ecf-3f515c506225 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.188461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37598ff0-33bd-4a0a-8ecf-3f515c506225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.188461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37598ff0-33bd-4a0a-8ecf-3f515c506225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.189599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37598ff0-33bd-4a0a-8ecf-3f515c506225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:09.197654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37598ff0-33bd-4a0a-8ecf-3f515c506225 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:09.199414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6e35f8b26c46f39d585d0edb2601d1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.201744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6e35f8b26c46f39d585d0edb2601d1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.218013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:09.242774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 856/1729] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:09.245556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374e5e-4f1a-453a-acd7-7c7b9d6c3e31 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.246192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374e5e-4f1a-453a-acd7-7c7b9d6c3e31 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.246813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f374e5e-4f1a-453a-acd7-7c7b9d6c3e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.287458 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 874/1730] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:08 2022] DELETE /identity/v3/users/2c6e35f8b26c46f39d585d0edb2601d1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:09.289079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:09.296023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:09.305867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4f374e5e-4f1a-453a-acd7-7c7b9d6c3e31 None None] MFA Rules not processed for user `af3eef42cf30440aaf30f3ddb882fd04`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:09.310428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4f374e5e-4f1a-453a-acd7-7c7b9d6c3e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:09.441738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476237e-be44-4aff-9f7b-343874325f1b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:09.449203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:09.449950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.450248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.451259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] PATH_INFO: `/v3/projects/8a801fa3022e4356baa56fa29b84c0d4` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.454754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a801fa3022e4356baa56fa29b84c0d4)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:09.460325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:09.536276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 857/1731] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:16:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:09.541878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f374e5e-4f1a-453a-acd7-7c7b9d6c3e31 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:09.555929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4f374e5e-4f1a-453a-acd7-7c7b9d6c3e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:09.568587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a801fa3022e4356baa56fa29b84c0d4', 'request_id': 'req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.581635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a801fa3022e4356baa56fa29b84c0d4', 'request_id': 'req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.593695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a801fa3022e4356baa56fa29b84c0d4', 'request_id': 'req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.613852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] The token cache is being invalidate because project 8a801fa3022e4356baa56fa29b84c0d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:09.613852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.615451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.617652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 875/1732] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:09 2022] DELETE /identity/v3/projects/8a801fa3022e4356baa56fa29b84c0d4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:09.618603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:09.622065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:09.666738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f374e5e-4f1a-453a-acd7-7c7b9d6c3e31 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:09.747131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bde6b-8e84-49a4-a645-58bb23e9c5b9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:09.763928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:09.766401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.771205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.771205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] PATH_INFO: `/v3/projects/e0d11bd831e54d608f023e950242df39/users/a13e3dddecfd4dfe982534eed31f89c7/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.872354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d11bd831e54d608f023e950242df39, user_id=a13e3dddecfd4dfe982534eed31f89c7, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:09.890495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:09.890980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:09.892017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.892505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.893252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] PATH_INFO: `/v3/users/c2d5a74c37c247629b49d74b17e22662` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.897042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d5a74c37c247629b49d74b17e22662)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:09.902718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:09.932551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:09.971549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 876/1733] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:09 2022] PUT /identity/v3/projects/e0d11bd831e54d608f023e950242df39/users/a13e3dddecfd4dfe982534eed31f89c7/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:09.973559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:09.983995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.045396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d5a74c37c247629b49d74b17e22662'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.056903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d5a74c37c247629b49d74b17e22662'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.059475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d5a74c37c247629b49d74b17e22662'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.086759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d5a74c37c247629b49d74b17e22662'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.113309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d5a74c37c247629b49d74b17e22662'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.139577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 858/1734] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:09 2022] DELETE /identity/v3/users/c2d5a74c37c247629b49d74b17e22662 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:10.141616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.144756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.208953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bee6af-392e-42b1-9f40-603a571a5616 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.218438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:10.291175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90269185-f202-4804-97d3-5cfd773111c9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.295425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.296430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.296913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.297261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.300038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.313277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.314960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.325028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 859/1735] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:10.326060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.327693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.369410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.370939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.371721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.372536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] PATH_INFO: `/v3/users/a484a0b6255140fdaa66b9d5b81dbda6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.375363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a484a0b6255140fdaa66b9d5b81dbda6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.380034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.409694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79bbc8-c0ee-4c24-ba71-b201d7d68a01 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.416312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a922902-85df-4ffc-b626-57e12829965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.417267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922902-85df-4ffc-b626-57e12829965e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.419278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922902-85df-4ffc-b626-57e12829965e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.419695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922902-85df-4ffc-b626-57e12829965e admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.420949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a922902-85df-4ffc-b626-57e12829965e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.424613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a922902-85df-4ffc-b626-57e12829965e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.441099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 860/1736] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:10.442872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b95b7-6e89-4cc6-8aed-0d4cb52482d0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.443291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b95b7-6e89-4cc6-8aed-0d4cb52482d0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.443731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b95b7-6e89-4cc6-8aed-0d4cb52482d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.489760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-266b95b7-6e89-4cc6-8aed-0d4cb52482d0 None None] MFA Rules not processed for user `eaf3d36d40d442019e09a3e4c32b8330`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:10.491783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-266b95b7-6e89-4cc6-8aed-0d4cb52482d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.517293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a484a0b6255140fdaa66b9d5b81dbda6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.540535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a484a0b6255140fdaa66b9d5b81dbda6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.542979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a484a0b6255140fdaa66b9d5b81dbda6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.560618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a484a0b6255140fdaa66b9d5b81dbda6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.562073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a484a0b6255140fdaa66b9d5b81dbda6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:10.626890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 877/1737] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:09 2022] DELETE /identity/v3/users/a484a0b6255140fdaa66b9d5b81dbda6 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:10.629105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.638960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.736603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 861/1738] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:10.756196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:10.839283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ff69-30bf-47d7-811e-23b9defc1444 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.850054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.850370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.850725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.851146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] PATH_INFO: `/v3/projects/e0d11bd831e54d608f023e950242df39/users/a13e3dddecfd4dfe982534eed31f89c7/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.853470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d11bd831e54d608f023e950242df39, user_id=a13e3dddecfd4dfe982534eed31f89c7, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.856695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.870977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 878/1739] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:10 2022] PUT /identity/v3/projects/e0d11bd831e54d608f023e950242df39/users/a13e3dddecfd4dfe982534eed31f89c7/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:10.883325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6a5e2-434b-40ac-82fc-495609759826 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.883926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6a5e2-434b-40ac-82fc-495609759826 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.884357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6a5e2-434b-40ac-82fc-495609759826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.949402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-55b6a5e2-434b-40ac-82fc-495609759826 None None] MFA Rules not processed for user `a13e3dddecfd4dfe982534eed31f89c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:10.950688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-55b6a5e2-434b-40ac-82fc-495609759826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:11.052964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:11.175209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 862/1740] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:11.190877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:11.196149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:11.281099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6a5e2-434b-40ac-82fc-495609759826 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:11.283487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-55b6a5e2-434b-40ac-82fc-495609759826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:11.366925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d916-f280-4174-8249-e8d385f430a8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:11.377506 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997fed3-570f-45b7-b78a-d5b8f6da4756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:11.382579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997fed3-570f-45b7-b78a-d5b8f6da4756 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:11.383168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997fed3-570f-45b7-b78a-d5b8f6da4756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:11.383636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997fed3-570f-45b7-b78a-d5b8f6da4756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:11.409670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997fed3-570f-45b7-b78a-d5b8f6da4756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:11.417401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997fed3-570f-45b7-b78a-d5b8f6da4756 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:11.448585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 879/1741] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:11.488850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6a5e2-434b-40ac-82fc-495609759826 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:11.496460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:11.497303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:11.497729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:11.500771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] PATH_INFO: `/v3/projects/0c7ba9e37e8e459a970738a4092186e9` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:11.518874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7ba9e37e8e459a970738a4092186e9)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:11.521667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:11.663924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7ba9e37e8e459a970738a4092186e9', 'request_id': 'req-a45a49f0-529f-474b-8ade-d6f97233b78d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:11.705861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7ba9e37e8e459a970738a4092186e9', 'request_id': 'req-a45a49f0-529f-474b-8ade-d6f97233b78d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:11.715119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997fed3-570f-45b7-b78a-d5b8f6da4756 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:11.728509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997fed3-570f-45b7-b78a-d5b8f6da4756 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:11.761760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7ba9e37e8e459a970738a4092186e9', 'request_id': 'req-a45a49f0-529f-474b-8ade-d6f97233b78d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:11.842853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] The token cache is being invalidate because project 0c7ba9e37e8e459a970738a4092186e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:11.843358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:11.850069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:11.857246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 863/1742] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:11 2022] DELETE /identity/v3/projects/0c7ba9e37e8e459a970738a4092186e9 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:11.857246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:11.861184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:11.894964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de4f8c-8513-4dde-866b-d239f18cab7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:11.896721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4f8c-8513-4dde-866b-d239f18cab7b service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:11.897217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4f8c-8513-4dde-866b-d239f18cab7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:11.897681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4f8c-8513-4dde-866b-d239f18cab7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:11.903142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a6de4f8c-8513-4dde-866b-d239f18cab7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:12.068777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de4f8c-8513-4dde-866b-d239f18cab7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:12.071049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de4f8c-8513-4dde-866b-d239f18cab7b service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:12.109046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 880/1743] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:12.110802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f86e8-ef78-4e67-b96d-b08b9828ad96 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.110993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f86e8-ef78-4e67-b96d-b08b9828ad96 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.111273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f86e8-ef78-4e67-b96d-b08b9828ad96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.136618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:12.171047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-937f86e8-ef78-4e67-b96d-b08b9828ad96 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:12.172648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-937f86e8-ef78-4e67-b96d-b08b9828ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:12.189579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:12.218001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a49f0-529f-474b-8ade-d6f97233b78d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:12.253365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:12.254015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.254898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.255524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.269203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:12.409427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 881/1744] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:12.414148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f86e8-ef78-4e67-b96d-b08b9828ad96 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:12.419073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-937f86e8-ef78-4e67-b96d-b08b9828ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:12.461969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f86e8-ef78-4e67-b96d-b08b9828ad96 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:12.462495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:12.464163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:12.485123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:12.488467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.489621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.490401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] PATH_INFO: `/v3/projects/88f19a347e714364a000236c1abf2c6f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.492372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f19a347e714364a000236c1abf2c6f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:12.492584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 864/1745] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:12.507261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:12.509003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:12.512580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:12.741292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f19a347e714364a000236c1abf2c6f', 'request_id': 'req-27d78a18-3f4e-49dd-b4d7-db863af87126'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:12.782089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f19a347e714364a000236c1abf2c6f', 'request_id': 'req-27d78a18-3f4e-49dd-b4d7-db863af87126'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:12.809696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f19a347e714364a000236c1abf2c6f', 'request_id': 'req-27d78a18-3f4e-49dd-b4d7-db863af87126'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:12.834937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8518-f113-451c-b942-610e7f946a09 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:12.845408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] The token cache is being invalidate because project 88f19a347e714364a000236c1abf2c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:12.848893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:12.858674 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-27d78a18-3f4e-49dd-b4d7-db863af87126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:12.869898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 882/1746] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:12 2022] DELETE /identity/v3/projects/88f19a347e714364a000236c1abf2c6f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:12.871636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36ee1-fdd7-488c-842c-aeb12cccc242 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.872010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36ee1-fdd7-488c-842c-aeb12cccc242 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.872384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36ee1-fdd7-488c-842c-aeb12cccc242 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.874400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 883/1747] 10.222.0.43 () {54 vars in 961 bytes} [Thu Sep 1 08:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:16:12.875731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941352-85b3-493a-983e-761231eb9cb1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.876109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941352-85b3-493a-983e-761231eb9cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.876462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b941352-85b3-493a-983e-761231eb9cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.942721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0b941352-85b3-493a-983e-761231eb9cb1 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:12.944456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0b941352-85b3-493a-983e-761231eb9cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:12.987335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519979-7de3-4636-aa22-5f0b9de6d6b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:12.988593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519979-7de3-4636-aa22-5f0b9de6d6b7 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.989100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519979-7de3-4636-aa22-5f0b9de6d6b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.989594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519979-7de3-4636-aa22-5f0b9de6d6b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.994772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cb519979-7de3-4636-aa22-5f0b9de6d6b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:13.030104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb519979-7de3-4636-aa22-5f0b9de6d6b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:13.034111 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb519979-7de3-4636-aa22-5f0b9de6d6b7 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:13.058342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 865/1748] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:13.067792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136932c7-1b4c-4769-8804-0c0651ebd718 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.069373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136932c7-1b4c-4769-8804-0c0651ebd718 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.069922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136932c7-1b4c-4769-8804-0c0651ebd718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.193516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-136932c7-1b4c-4769-8804-0c0651ebd718 None None] MFA Rules not processed for user `7559a0b8d46b4524b40f68b992f6cfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:13.200529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-136932c7-1b4c-4769-8804-0c0651ebd718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:13.238150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 884/1749] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:13.247203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16c5d-ae30-4e1d-9b51-4f9939a4a599 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.250663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16c5d-ae30-4e1d-9b51-4f9939a4a599 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.253266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16c5d-ae30-4e1d-9b51-4f9939a4a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.258986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:13.373462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-03a16c5d-ae30-4e1d-9b51-4f9939a4a599 None None] MFA Rules not processed for user `854e77042ee14f7f806a33f9c9501bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:13.381699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-03a16c5d-ae30-4e1d-9b51-4f9939a4a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:13.434420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 866/1750] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:13.448069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136932c7-1b4c-4769-8804-0c0651ebd718 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:13.454963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-136932c7-1b4c-4769-8804-0c0651ebd718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:13.499924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136932c7-1b4c-4769-8804-0c0651ebd718 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:13.508625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:13.509610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.510142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.510597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] PATH_INFO: `/v3/projects/f936bff93700480eba74363537433c24` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.512410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f936bff93700480eba74363537433c24)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:13.516127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:13.566846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:13.634559 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f936bff93700480eba74363537433c24', 'request_id': 'req-fb4a3a2b-f9f8-4a6c-b306-143671f019af'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:13.669739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f936bff93700480eba74363537433c24', 'request_id': 'req-fb4a3a2b-f9f8-4a6c-b306-143671f019af'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:13.705087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 885/1751] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:13.728762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f936bff93700480eba74363537433c24', 'request_id': 'req-fb4a3a2b-f9f8-4a6c-b306-143671f019af'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:13.737435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ab19-b2d2-4db8-9249-b7b8e92e8510 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.747081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ab19-b2d2-4db8-9249-b7b8e92e8510 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.747752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ab19-b2d2-4db8-9249-b7b8e92e8510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.921274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] The token cache is being invalidate because project f936bff93700480eba74363537433c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:13.921781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:13.933711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fb4a3a2b-f9f8-4a6c-b306-143671f019af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:13.951816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 867/1752] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:13 2022] DELETE /identity/v3/projects/f936bff93700480eba74363537433c24 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:13.958861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5658c1-80b1-49df-afec-7e4d8af364c6 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.963682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5658c1-80b1-49df-afec-7e4d8af364c6 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.964352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5658c1-80b1-49df-afec-7e4d8af364c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.996099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a4a6ab19-b2d2-4db8-9249-b7b8e92e8510 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:13.997377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a4a6ab19-b2d2-4db8-9249-b7b8e92e8510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.114806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-dc5658c1-80b1-49df-afec-7e4d8af364c6 None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:14.116886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dc5658c1-80b1-49df-afec-7e4d8af364c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.218631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 886/1753] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:14.219800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ab19-b2d2-4db8-9249-b7b8e92e8510 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:14.225258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a4a6ab19-b2d2-4db8-9249-b7b8e92e8510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.255627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ab19-b2d2-4db8-9249-b7b8e92e8510 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:14.269723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:14.274475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:14.274804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:14.276572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:14.278161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:14.278161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:14.288547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:14.325291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 887/1754] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:14.332840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:14.339937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.513567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 868/1755] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Sep 1 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:14.515462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6191-1f23-4e77-a148-6524b0e8acb7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:14.526554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6191-1f23-4e77-a148-6524b0e8acb7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:14.526928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6191-1f23-4e77-a148-6524b0e8acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:14.673682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-908b6191-1f23-4e77-a148-6524b0e8acb7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:14.683000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-908b6191-1f23-4e77-a148-6524b0e8acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.717103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd465693-009a-4705-a24e-b3c650132003 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:14.738220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 869/1756] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:14.741042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be0e5-286d-4087-b962-c15afa5d9097 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:14.743631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f71f9-ceaf-4e5f-bacc-1ebd228500e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:14.744651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f71f9-ceaf-4e5f-bacc-1ebd228500e9 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:14.744976 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f71f9-ceaf-4e5f-bacc-1ebd228500e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:14.746597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f71f9-ceaf-4e5f-bacc-1ebd228500e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:14.747841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be0e5-286d-4087-b962-c15afa5d9097 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:14.749515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be0e5-286d-4087-b962-c15afa5d9097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:14.759261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-168f71f9-ceaf-4e5f-bacc-1ebd228500e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.831275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-188be0e5-286d-4087-b962-c15afa5d9097 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:14.836847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-188be0e5-286d-4087-b962-c15afa5d9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.862001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 870/1757] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:14.864468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188be0e5-286d-4087-b962-c15afa5d9097 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:14.896309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188be0e5-286d-4087-b962-c15afa5d9097 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:14.910456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2965b-4b5c-418c-9bda-a50592197926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:14.913965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2965b-4b5c-418c-9bda-a50592197926 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:14.915276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2965b-4b5c-418c-9bda-a50592197926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:14.915921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2965b-4b5c-418c-9bda-a50592197926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:14.917708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2965b-4b5c-418c-9bda-a50592197926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:14.920465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2965b-4b5c-418c-9bda-a50592197926 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:14.969640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f71f9-ceaf-4e5f-bacc-1ebd228500e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:14.975274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f71f9-ceaf-4e5f-bacc-1ebd228500e9 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:14.995815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 871/1758] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:14 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:14.995815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2965b-4b5c-418c-9bda-a50592197926 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:14.997920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 888/1759] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:14.999566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3adc9-b276-4f0f-8ee6-fe7b84b99b37 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:15.000063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3adc9-b276-4f0f-8ee6-fe7b84b99b37 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:15.001540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3adc9-b276-4f0f-8ee6-fe7b84b99b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:15.031087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:15.068455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-08d3adc9-b276-4f0f-8ee6-fe7b84b99b37 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:15.083413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-08d3adc9-b276-4f0f-8ee6-fe7b84b99b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:15.101729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:15.331799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 889/1760] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:15.336919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3adc9-b276-4f0f-8ee6-fe7b84b99b37 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:15.362744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3adc9-b276-4f0f-8ee6-fe7b84b99b37 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:15.379012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:15.379952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:15.380245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:15.380519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:15.381206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:15.381527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:15.383414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:15.393995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2965b-4b5c-418c-9bda-a50592197926 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:15.432926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 890/1761] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:15.433999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:15.436459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:15.455500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:15.458403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:15.459152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:15.485666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928c067-31b9-4910-84e4-d25c1d7280d5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:15.510568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5ef0-19f2-4646-9db1-22d16c3ef4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:15.511220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5ef0-19f2-4646-9db1-22d16c3ef4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:15.511572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5ef0-19f2-4646-9db1-22d16c3ef4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:15.512205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5ef0-19f2-4646-9db1-22d16c3ef4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:15.512909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5ef0-19f2-4646-9db1-22d16c3ef4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:15.515007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5ef0-19f2-4646-9db1-22d16c3ef4b8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:15.537756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:15.575569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 891/1762] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:15 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:15.577726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5ef0-19f2-4646-9db1-22d16c3ef4b8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:15.604594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5ef0-19f2-4646-9db1-22d16c3ef4b8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:15.621967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:15.622613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:15.632765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:15.633160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:15.634834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:15.641333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:15.641741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:15.641914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:15.647742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:15.719405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 872/1763] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:15.726753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:15.737688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 892/1764] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:15.743549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:15.775309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde2fdb-0b4b-481e-b889-3a80e9a1d480 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:15.798739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb34c-4428-4bc5-b221-34409b6154d2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:15.804310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e90257-6053-4991-902c-cfccf67f738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:15.805021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e90257-6053-4991-902c-cfccf67f738b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:15.805428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e90257-6053-4991-902c-cfccf67f738b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:15.805716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e90257-6053-4991-902c-cfccf67f738b admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:15.806420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e90257-6053-4991-902c-cfccf67f738b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:15.808630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e90257-6053-4991-902c-cfccf67f738b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:15.832697 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb25409-4472-4bd3-94ef-65b8ecc88a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:15.837220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb25409-4472-4bd3-94ef-65b8ecc88a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:15.839741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb25409-4472-4bd3-94ef-65b8ecc88a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:15.840136 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb25409-4472-4bd3-94ef-65b8ecc88a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:15.846591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb25409-4472-4bd3-94ef-65b8ecc88a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:15.854314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb25409-4472-4bd3-94ef-65b8ecc88a49 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:15.930351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 893/1765] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:15.931506 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb25409-4472-4bd3-94ef-65b8ecc88a49 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:15.935369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 873/1766] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:15 2022] POST /identity/v3/projects => generated 401 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:15.948534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e90257-6053-4991-902c-cfccf67f738b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:16.000111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb25409-4472-4bd3-94ef-65b8ecc88a49 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:16.071099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e90257-6053-4991-902c-cfccf67f738b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:16.078869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fb11e-e2bc-4b2d-98dc-6228d4ecba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:16.079826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fb11e-e2bc-4b2d-98dc-6228d4ecba62 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:16.080213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fb11e-e2bc-4b2d-98dc-6228d4ecba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:16.080721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fb11e-e2bc-4b2d-98dc-6228d4ecba62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:16.081503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fb11e-e2bc-4b2d-98dc-6228d4ecba62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:16.084377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fb11e-e2bc-4b2d-98dc-6228d4ecba62 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:16.105574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 874/1767] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:16.106741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fb11e-e2bc-4b2d-98dc-6228d4ecba62 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:16.120529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fb11e-e2bc-4b2d-98dc-6228d4ecba62 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:16.126411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4ef2-52cb-4205-bbc1-d7df162f236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:16.127097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4ef2-52cb-4205-bbc1-d7df162f236e admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:16.127383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4ef2-52cb-4205-bbc1-d7df162f236e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:16.127655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4ef2-52cb-4205-bbc1-d7df162f236e admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:16.128312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4ef2-52cb-4205-bbc1-d7df162f236e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:16.131592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4ef2-52cb-4205-bbc1-d7df162f236e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:16.174215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 875/1768] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:16 2022] POST /identity/v3/users => generated 301 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:16.178513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4ef2-52cb-4205-bbc1-d7df162f236e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:16.211961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4ef2-52cb-4205-bbc1-d7df162f236e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:16.218844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b98a5-bcc8-4935-a946-28f5ee0cf018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:16.219733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b98a5-bcc8-4935-a946-28f5ee0cf018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:16.220086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b98a5-bcc8-4935-a946-28f5ee0cf018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:16.220429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b98a5-bcc8-4935-a946-28f5ee0cf018 admin admin] PATH_INFO: `/v3/projects/a17ccbc0b95a4792846f90d1948be512/users/bab5a1b40b434ab6bed93c0ad7961c51/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:16.244519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b98a5-bcc8-4935-a946-28f5ee0cf018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17ccbc0b95a4792846f90d1948be512, user_id=bab5a1b40b434ab6bed93c0ad7961c51, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:16.250517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b98a5-bcc8-4935-a946-28f5ee0cf018 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:16.291782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 876/1769] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:16 2022] PUT /identity/v3/projects/a17ccbc0b95a4792846f90d1948be512/users/bab5a1b40b434ab6bed93c0ad7961c51/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:16.295015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b98a5-bcc8-4935-a946-28f5ee0cf018 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:16.295493 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56741793-cba8-42f6-afce-20624679f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:16.296655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56741793-cba8-42f6-afce-20624679f3bc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:16.297145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56741793-cba8-42f6-afce-20624679f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:16.297440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56741793-cba8-42f6-afce-20624679f3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:16.298126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56741793-cba8-42f6-afce-20624679f3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:16.300152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56741793-cba8-42f6-afce-20624679f3bc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:16.374368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 894/1770] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:15 2022] POST /identity/v3/projects => generated 373 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:16.378209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98330c-0c7b-496e-951a-306726c514bb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:16.378569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98330c-0c7b-496e-951a-306726c514bb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:16.378858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98330c-0c7b-496e-951a-306726c514bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:16.402763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:16.458867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7f98330c-0c7b-496e-951a-306726c514bb None None] MFA Rules not processed for user `bab5a1b40b434ab6bed93c0ad7961c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:16.462580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f98330c-0c7b-496e-951a-306726c514bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:16.558091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:16.575875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b98a5-bcc8-4935-a946-28f5ee0cf018 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:16.744354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 895/1771] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:16.745391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98330c-0c7b-496e-951a-306726c514bb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:16.825669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc83ee-2386-4ed1-b435-07759a58b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:16.828122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc83ee-2386-4ed1-b435-07759a58b4de admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:16.828787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc83ee-2386-4ed1-b435-07759a58b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:16.829654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc83ee-2386-4ed1-b435-07759a58b4de admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:16.831213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc83ee-2386-4ed1-b435-07759a58b4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:16.837281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc83ee-2386-4ed1-b435-07759a58b4de admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:16.865142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 877/1772] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:16.871146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc83ee-2386-4ed1-b435-07759a58b4de admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:16.916248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc83ee-2386-4ed1-b435-07759a58b4de admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:16.941185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee8afc-60ac-4fa2-9ea9-9045610284e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:16.948690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8afc-60ac-4fa2-9ea9-9045610284e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:16.949307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8afc-60ac-4fa2-9ea9-9045610284e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:16.949702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8afc-60ac-4fa2-9ea9-9045610284e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:16.950995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee8afc-60ac-4fa2-9ea9-9045610284e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:16.954410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee8afc-60ac-4fa2-9ea9-9045610284e8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.062331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98330c-0c7b-496e-951a-306726c514bb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.074357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 878/1773] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:16 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:17.074357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee8afc-60ac-4fa2-9ea9-9045610284e8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:17.085586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc136-5fb2-4874-bb94-e5507642d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.087501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc136-5fb2-4874-bb94-e5507642d9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.090417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc136-5fb2-4874-bb94-e5507642d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.090715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc136-5fb2-4874-bb94-e5507642d9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.091402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc136-5fb2-4874-bb94-e5507642d9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.096248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc136-5fb2-4874-bb94-e5507642d9f7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.206333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 896/1774] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:16 2022] POST /identity/v3/users => generated 287 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:17.206977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc136-5fb2-4874-bb94-e5507642d9f7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:17.238586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc136-5fb2-4874-bb94-e5507642d9f7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.357177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee8afc-60ac-4fa2-9ea9-9045610284e8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.373910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43324cfc-53ca-40c0-a721-22fcb5842584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.374810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43324cfc-53ca-40c0-a721-22fcb5842584 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.375197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43324cfc-53ca-40c0-a721-22fcb5842584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.375587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43324cfc-53ca-40c0-a721-22fcb5842584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.376577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43324cfc-53ca-40c0-a721-22fcb5842584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.382758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43324cfc-53ca-40c0-a721-22fcb5842584 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.419448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa69f84-d7a8-42cc-8a12-d2e0a0fa2900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.420404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa69f84-d7a8-42cc-8a12-d2e0a0fa2900 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.420832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa69f84-d7a8-42cc-8a12-d2e0a0fa2900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.421278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa69f84-d7a8-42cc-8a12-d2e0a0fa2900 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.422465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa69f84-d7a8-42cc-8a12-d2e0a0fa2900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.422999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 879/1775] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:17.424039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43324cfc-53ca-40c0-a721-22fcb5842584 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:17.425003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa69f84-d7a8-42cc-8a12-d2e0a0fa2900 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.442184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43324cfc-53ca-40c0-a721-22fcb5842584 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.456810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36669e-edae-4d11-8c68-bf84b378b96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.458366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36669e-edae-4d11-8c68-bf84b378b96e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.459050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36669e-edae-4d11-8c68-bf84b378b96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.459694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36669e-edae-4d11-8c68-bf84b378b96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.462333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36669e-edae-4d11-8c68-bf84b378b96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.468975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36669e-edae-4d11-8c68-bf84b378b96e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.496180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 897/1776] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:17 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:17.501574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa69f84-d7a8-42cc-8a12-d2e0a0fa2900 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:17.506469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 880/1777] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:17.508157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36669e-edae-4d11-8c68-bf84b378b96e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:17.532470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36669e-edae-4d11-8c68-bf84b378b96e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.544891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d285b-01f7-4352-a8cd-bec934ebdc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.548522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d285b-01f7-4352-a8cd-bec934ebdc51 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.549180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d285b-01f7-4352-a8cd-bec934ebdc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.549977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d285b-01f7-4352-a8cd-bec934ebdc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.552558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d285b-01f7-4352-a8cd-bec934ebdc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.554470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa69f84-d7a8-42cc-8a12-d2e0a0fa2900 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.557294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d285b-01f7-4352-a8cd-bec934ebdc51 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.570541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ef4b0-4abf-442c-bb0a-4f2691400d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.571788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ef4b0-4abf-442c-bb0a-4f2691400d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.572220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ef4b0-4abf-442c-bb0a-4f2691400d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.572781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ef4b0-4abf-442c-bb0a-4f2691400d62 admin admin] PATH_INFO: `/v3/projects/baac1ae747b943ce86a5ac86859c44ce/users/a38e947d7cad4e4d80a92c6ba1485d8e/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.587791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 881/1778] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:17.589436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d285b-01f7-4352-a8cd-bec934ebdc51 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:17.617050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d285b-01f7-4352-a8cd-bec934ebdc51 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.626310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ef4b0-4abf-442c-bb0a-4f2691400d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baac1ae747b943ce86a5ac86859c44ce, user_id=a38e947d7cad4e4d80a92c6ba1485d8e, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.633199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ef4b0-4abf-442c-bb0a-4f2691400d62 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.643742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf473-4b25-41cd-9b76-1d632aa570de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.645895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf473-4b25-41cd-9b76-1d632aa570de admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.647542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf473-4b25-41cd-9b76-1d632aa570de admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.650225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf473-4b25-41cd-9b76-1d632aa570de admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.651430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf473-4b25-41cd-9b76-1d632aa570de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.655905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf473-4b25-41cd-9b76-1d632aa570de admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.671219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 898/1779] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:17 2022] PUT /identity/v3/projects/baac1ae747b943ce86a5ac86859c44ce/users/a38e947d7cad4e4d80a92c6ba1485d8e/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:17.673085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ef4b0-4abf-442c-bb0a-4f2691400d62 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:17.693970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 882/1780] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:17.695558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd9670-4a56-403d-bea2-8b6bb745b7dd None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.695814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd9670-4a56-403d-bea2-8b6bb745b7dd None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.696272 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd9670-4a56-403d-bea2-8b6bb745b7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.720551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:17.734480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7dfd9670-4a56-403d-bea2-8b6bb745b7dd None None] MFA Rules not processed for user `a38e947d7cad4e4d80a92c6ba1485d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:17.737032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7dfd9670-4a56-403d-bea2-8b6bb745b7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:17.774862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:17.899063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ef4b0-4abf-442c-bb0a-4f2691400d62 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.903187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 883/1781] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:17 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:17.904370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd9670-4a56-403d-bea2-8b6bb745b7dd None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:17.917237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd9670-4a56-403d-bea2-8b6bb745b7dd None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:17.925587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbe5d-c6be-4d03-be44-5a59971f6414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.927084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbe5d-c6be-4d03-be44-5a59971f6414 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.927379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbe5d-c6be-4d03-be44-5a59971f6414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.928031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbe5d-c6be-4d03-be44-5a59971f6414 admin admin] PATH_INFO: `/v3/projects/14771d0592024ef9921b981f22e01c08/users/dcfc3da8cca746a986c955b7b764e5d2/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.929169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ae19d-ac68-4c7d-8a5a-d6d1019e46d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:17.933295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae19d-ac68-4c7d-8a5a-d6d1019e46d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:17.935595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae19d-ac68-4c7d-8a5a-d6d1019e46d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:17.936349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae19d-ac68-4c7d-8a5a-d6d1019e46d3 admin admin] PATH_INFO: `/v3/projects/6b9f8d6e9fed4baa8e191b04632fb3f7/users/5d812bbd162a461f911891ae6e4fafb6/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:17.951846 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfbe5d-c6be-4d03-be44-5a59971f6414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14771d0592024ef9921b981f22e01c08, user_id=dcfc3da8cca746a986c955b7b764e5d2, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.955154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfbe5d-c6be-4d03-be44-5a59971f6414 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:17.995757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ae19d-ac68-4c7d-8a5a-d6d1019e46d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9f8d6e9fed4baa8e191b04632fb3f7, user_id=5d812bbd162a461f911891ae6e4fafb6, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:17.998989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ae19d-ac68-4c7d-8a5a-d6d1019e46d3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.007094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 884/1782] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:17 2022] PUT /identity/v3/projects/14771d0592024ef9921b981f22e01c08/users/dcfc3da8cca746a986c955b7b764e5d2/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:18.008245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbe5d-c6be-4d03-be44-5a59971f6414 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.037677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 899/1783] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:17 2022] PUT /identity/v3/projects/6b9f8d6e9fed4baa8e191b04632fb3f7/users/5d812bbd162a461f911891ae6e4fafb6/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:18.042048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6615f-38fd-4d02-8570-2cd72eda249a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.042607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6615f-38fd-4d02-8570-2cd72eda249a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.042733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6615f-38fd-4d02-8570-2cd72eda249a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.129141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-09d6615f-38fd-4d02-8570-2cd72eda249a None None] MFA Rules not processed for user `dcfc3da8cca746a986c955b7b764e5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:18.130776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-09d6615f-38fd-4d02-8570-2cd72eda249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:18.209751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbe5d-c6be-4d03-be44-5a59971f6414 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.325049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 900/1784] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:18.326039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6615f-38fd-4d02-8570-2cd72eda249a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.358869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e792d-e276-483a-8266-31dc96ec2491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.360980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e792d-e276-483a-8266-31dc96ec2491 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.360980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e792d-e276-483a-8266-31dc96ec2491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.360980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e792d-e276-483a-8266-31dc96ec2491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.361901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e792d-e276-483a-8266-31dc96ec2491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.365346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e792d-e276-483a-8266-31dc96ec2491 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.411632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 885/1785] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:18 2022] POST /identity/v3/projects => generated 399 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:18.411632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e792d-e276-483a-8266-31dc96ec2491 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.423192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:18.501921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6615f-38fd-4d02-8570-2cd72eda249a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.545054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e792d-e276-483a-8266-31dc96ec2491 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.554740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc4a9c-b36f-4d32-8fa3-7d518449ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.556988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4a9c-b36f-4d32-8fa3-7d518449ceab admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.557840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4a9c-b36f-4d32-8fa3-7d518449ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.558363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4a9c-b36f-4d32-8fa3-7d518449ceab admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.560380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc4a9c-b36f-4d32-8fa3-7d518449ceab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.565113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc4a9c-b36f-4d32-8fa3-7d518449ceab admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.573425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:18.607364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682ab5-7314-4392-b91b-623267651888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.608971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682ab5-7314-4392-b91b-623267651888 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.609492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682ab5-7314-4392-b91b-623267651888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.609992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682ab5-7314-4392-b91b-623267651888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.612065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682ab5-7314-4392-b91b-623267651888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.616357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682ab5-7314-4392-b91b-623267651888 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.618170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 886/1786] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:18 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:18.619665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc4a9c-b36f-4d32-8fa3-7d518449ceab admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.644113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 901/1787] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:18.645958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682ab5-7314-4392-b91b-623267651888 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.658779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682ab5-7314-4392-b91b-623267651888 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.745492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc4a9c-b36f-4d32-8fa3-7d518449ceab admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.754703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01016321-a1ba-4d71-b094-137918cf614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.755358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016321-a1ba-4d71-b094-137918cf614f admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.755642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016321-a1ba-4d71-b094-137918cf614f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.755922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016321-a1ba-4d71-b094-137918cf614f admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.756151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109cf4e-c354-41e6-b8b5-837d7972f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.756737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01016321-a1ba-4d71-b094-137918cf614f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.757299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109cf4e-c354-41e6-b8b5-837d7972f24e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.757690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109cf4e-c354-41e6-b8b5-837d7972f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.758084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109cf4e-c354-41e6-b8b5-837d7972f24e admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.758754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01016321-a1ba-4d71-b094-137918cf614f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.759010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109cf4e-c354-41e6-b8b5-837d7972f24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.761599 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109cf4e-c354-41e6-b8b5-837d7972f24e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.802667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 902/1788] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:18 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:18.804619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fe42-2c6d-45db-a61e-cd781914bf7e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.805046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fe42-2c6d-45db-a61e-cd781914bf7e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.805516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fe42-2c6d-45db-a61e-cd781914bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.815245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 887/1789] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:18 2022] POST /identity/v3/users => generated 306 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:18.816066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01016321-a1ba-4d71-b094-137918cf614f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.830795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01016321-a1ba-4d71-b094-137918cf614f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.837519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdee7d-0c04-424e-83ae-1005d23614b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.838877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdee7d-0c04-424e-83ae-1005d23614b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.839299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdee7d-0c04-424e-83ae-1005d23614b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.839704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdee7d-0c04-424e-83ae-1005d23614b8 admin admin] PATH_INFO: `/v3/projects/6b9f8d6e9fed4baa8e191b04632fb3f7/users/5d812bbd162a461f911891ae6e4fafb6/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.845842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdee7d-0c04-424e-83ae-1005d23614b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9f8d6e9fed4baa8e191b04632fb3f7, user_id=5d812bbd162a461f911891ae6e4fafb6, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.848942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a624fe42-2c6d-45db-a61e-cd781914bf7e None None] MFA Rules not processed for user `eaf3d36d40d442019e09a3e4c32b8330`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:18.850753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a624fe42-2c6d-45db-a61e-cd781914bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:18.852168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdee7d-0c04-424e-83ae-1005d23614b8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.874568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 888/1790] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:18 2022] PUT /identity/v3/projects/6b9f8d6e9fed4baa8e191b04632fb3f7/users/5d812bbd162a461f911891ae6e4fafb6/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:18.875632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdee7d-0c04-424e-83ae-1005d23614b8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.982693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdee7d-0c04-424e-83ae-1005d23614b8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.985778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 903/1791] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:18.987226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624fe42-2c6d-45db-a61e-cd781914bf7e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.990102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b329c-eea3-47c5-8ffc-a49f2d664b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.990894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b329c-eea3-47c5-8ffc-a49f2d664b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.991211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b329c-eea3-47c5-8ffc-a49f2d664b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.991478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b329c-eea3-47c5-8ffc-a49f2d664b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.992194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b329c-eea3-47c5-8ffc-a49f2d664b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.994328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b329c-eea3-47c5-8ffc-a49f2d664b24 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.003273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624fe42-2c6d-45db-a61e-cd781914bf7e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.008142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 889/1792] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:19.009583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bbd1-399b-4a04-8b27-dc5e06246075 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.009880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bbd1-399b-4a04-8b27-dc5e06246075 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.010161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111bbd1-399b-4a04-8b27-dc5e06246075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.014253 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daf038-6324-4d38-b8ee-d8450561d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.014922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daf038-6324-4d38-b8ee-d8450561d512 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.015265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daf038-6324-4d38-b8ee-d8450561d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.015548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daf038-6324-4d38-b8ee-d8450561d512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.016567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4daf038-6324-4d38-b8ee-d8450561d512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.019422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:19.024158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4daf038-6324-4d38-b8ee-d8450561d512 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.049994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 904/1793] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:19.051472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daf038-6324-4d38-b8ee-d8450561d512 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.063632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daf038-6324-4d38-b8ee-d8450561d512 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.075280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad94fa-5df2-4cd7-81ac-42273fba1bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.076006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad94fa-5df2-4cd7-81ac-42273fba1bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.076354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad94fa-5df2-4cd7-81ac-42273fba1bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.076635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad94fa-5df2-4cd7-81ac-42273fba1bbf admin admin] PATH_INFO: `/v3/projects/25388812f6014a41952732fea3358459/users/298fe11ba1cc47d190287b3294d29a1d/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.086423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e111bbd1-399b-4a04-8b27-dc5e06246075 None None] MFA Rules not processed for user `5d812bbd162a461f911891ae6e4fafb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:19.093860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e111bbd1-399b-4a04-8b27-dc5e06246075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:19.107504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad94fa-5df2-4cd7-81ac-42273fba1bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=25388812f6014a41952732fea3358459, user_id=298fe11ba1cc47d190287b3294d29a1d, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.112527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad94fa-5df2-4cd7-81ac-42273fba1bbf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.133327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 905/1794] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:19 2022] PUT /identity/v3/projects/25388812f6014a41952732fea3358459/users/298fe11ba1cc47d190287b3294d29a1d/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:19.137311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad94fa-5df2-4cd7-81ac-42273fba1bbf admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.190780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 890/1795] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:19.193520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111bbd1-399b-4a04-8b27-dc5e06246075 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.215032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:19.220084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111bbd1-399b-4a04-8b27-dc5e06246075 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.245952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad94fa-5df2-4cd7-81ac-42273fba1bbf admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.252095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.252788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.253174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.253360 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] PATH_INFO: `/v3/projects/6c1de16cdda5465c86e76ab389e7d9a0/users/f82d2bb20b38430fa408957807930b95/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.273171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1de16cdda5465c86e76ab389e7d9a0, user_id=f82d2bb20b38430fa408957807930b95, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.276978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.302554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 906/1796] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:19 2022] PUT /identity/v3/projects/6c1de16cdda5465c86e76ab389e7d9a0/users/f82d2bb20b38430fa408957807930b95/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:19.304038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.306929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:19.369329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2cef4-f0fa-4e77-8fdf-f2adbf9ec451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.370117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2cef4-f0fa-4e77-8fdf-f2adbf9ec451 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.370625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2cef4-f0fa-4e77-8fdf-f2adbf9ec451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.370922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2cef4-f0fa-4e77-8fdf-f2adbf9ec451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.372270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2cef4-f0fa-4e77-8fdf-f2adbf9ec451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.374440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2cef4-f0fa-4e77-8fdf-f2adbf9ec451 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.392824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 891/1797] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:19.395868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2cef4-f0fa-4e77-8fdf-f2adbf9ec451 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.408807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2cef4-f0fa-4e77-8fdf-f2adbf9ec451 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.494738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc6c16-874f-4877-be66-4f85b829459c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.507156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2707-adba-4e04-8a2b-ad826a4f17f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.507854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2707-adba-4e04-8a2b-ad826a4f17f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.508146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2707-adba-4e04-8a2b-ad826a4f17f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.508462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2707-adba-4e04-8a2b-ad826a4f17f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.535362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387895ab-9af5-4b6b-900c-038a0bd9bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.536705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387895ab-9af5-4b6b-900c-038a0bd9bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.537204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387895ab-9af5-4b6b-900c-038a0bd9bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.537708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387895ab-9af5-4b6b-900c-038a0bd9bd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.538620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387895ab-9af5-4b6b-900c-038a0bd9bd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.541561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387895ab-9af5-4b6b-900c-038a0bd9bd2f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.560792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 892/1798] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:19.564107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387895ab-9af5-4b6b-900c-038a0bd9bd2f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.586150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387895ab-9af5-4b6b-900c-038a0bd9bd2f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.601490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f800c7b-7e3f-45ed-8ab8-223e3935642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.602616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f800c7b-7e3f-45ed-8ab8-223e3935642f admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.603135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f800c7b-7e3f-45ed-8ab8-223e3935642f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.604427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f800c7b-7e3f-45ed-8ab8-223e3935642f admin admin] PATH_INFO: `/v3/projects/25388812f6014a41952732fea3358459/users/298fe11ba1cc47d190287b3294d29a1d/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.607763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f800c7b-7e3f-45ed-8ab8-223e3935642f admin admin] RBAC: Authorizing `identity:create_grant(project_id=25388812f6014a41952732fea3358459, user_id=298fe11ba1cc47d190287b3294d29a1d, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.611440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f800c7b-7e3f-45ed-8ab8-223e3935642f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.637717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 893/1799] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:19 2022] PUT /identity/v3/projects/25388812f6014a41952732fea3358459/users/298fe11ba1cc47d190287b3294d29a1d/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:19.640352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f800c7b-7e3f-45ed-8ab8-223e3935642f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.667204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a2707-adba-4e04-8a2b-ad826a4f17f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.668773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a2707-adba-4e04-8a2b-ad826a4f17f2 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.689716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:19.702536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 907/1800] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:19.705032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c368-b0f7-43bf-9a96-08f12e2c43f1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.705326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c368-b0f7-43bf-9a96-08f12e2c43f1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.706625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c368-b0f7-43bf-9a96-08f12e2c43f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.785139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d4a5c368-b0f7-43bf-9a96-08f12e2c43f1 None None] MFA Rules not processed for user `298fe11ba1cc47d190287b3294d29a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:19.787695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d4a5c368-b0f7-43bf-9a96-08f12e2c43f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:19.884397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f800c7b-7e3f-45ed-8ab8-223e3935642f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.899501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25167eb1-680d-4ab3-afc2-66df54339b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.900608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167eb1-680d-4ab3-afc2-66df54339b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.900903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167eb1-680d-4ab3-afc2-66df54339b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.901185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167eb1-680d-4ab3-afc2-66df54339b3b admin admin] PATH_INFO: `/v3/projects/6c1de16cdda5465c86e76ab389e7d9a0/users/f82d2bb20b38430fa408957807930b95/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.905077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25167eb1-680d-4ab3-afc2-66df54339b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1de16cdda5465c86e76ab389e7d9a0, user_id=f82d2bb20b38430fa408957807930b95, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.909047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25167eb1-680d-4ab3-afc2-66df54339b3b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.938250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 894/1801] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:19 2022] PUT /identity/v3/projects/6c1de16cdda5465c86e76ab389e7d9a0/users/f82d2bb20b38430fa408957807930b95/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:19.939585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d660-ab89-4215-aa2e-70eda5d24386 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.939872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d660-ab89-4215-aa2e-70eda5d24386 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.940149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d660-ab89-4215-aa2e-70eda5d24386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.980014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-99e3d660-ab89-4215-aa2e-70eda5d24386 None None] MFA Rules not processed for user `7559a0b8d46b4524b40f68b992f6cfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:19.981289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-99e3d660-ab89-4215-aa2e-70eda5d24386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:19.998704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:20.021416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 908/1802] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:20.022460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c368-b0f7-43bf-9a96-08f12e2c43f1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:20.123891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c368-b0f7-43bf-9a96-08f12e2c43f1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:20.137592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 895/1803] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:20.138927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06354e6-e2d4-4a57-bedd-cce6be08d6d5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:20.139221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06354e6-e2d4-4a57-bedd-cce6be08d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:20.139503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06354e6-e2d4-4a57-bedd-cce6be08d6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:20.232204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d06354e6-e2d4-4a57-bedd-cce6be08d6d5 None None] MFA Rules not processed for user `f82d2bb20b38430fa408957807930b95`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:20.234169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d06354e6-e2d4-4a57-bedd-cce6be08d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:20.276322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:20.276903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:20.277191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:20.277471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:20.372160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:20.373684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:20.392882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 909/1804] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:20.395206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:20.399710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:20.433010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00061ee-e021-4db7-b4bb-c931b7584e98 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:20.451565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35837ea8-361f-41a7-a604-19c97af7ed16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:20.452373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35837ea8-361f-41a7-a604-19c97af7ed16 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:20.452665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35837ea8-361f-41a7-a604-19c97af7ed16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:20.453063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35837ea8-361f-41a7-a604-19c97af7ed16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:20.501196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 896/1805] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:20.571605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06354e6-e2d4-4a57-bedd-cce6be08d6d5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:20.595260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06354e6-e2d4-4a57-bedd-cce6be08d6d5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:20.602887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9504ee-66c2-4337-bdec-e9409470694a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:20.603286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9504ee-66c2-4337-bdec-e9409470694a service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:20.603668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9504ee-66c2-4337-bdec-e9409470694a service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:20.604036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9504ee-66c2-4337-bdec-e9409470694a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:20.647420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9504ee-66c2-4337-bdec-e9409470694a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:20.653262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9504ee-66c2-4337-bdec-e9409470694a service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:20.681838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 897/1806] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:20.736716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35837ea8-361f-41a7-a604-19c97af7ed16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:20.738538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35837ea8-361f-41a7-a604-19c97af7ed16 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:20.769353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 910/1807] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:20.894144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9504ee-66c2-4337-bdec-e9409470694a service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:20.924622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9504ee-66c2-4337-bdec-e9409470694a service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:20.972035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7503-dfc9-454e-bd85-a40faa996890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:20.973046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7503-dfc9-454e-bd85-a40faa996890 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:20.973329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7503-dfc9-454e-bd85-a40faa996890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:20.973801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7503-dfc9-454e-bd85-a40faa996890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:21.017829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:21.124221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7503-dfc9-454e-bd85-a40faa996890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:21.125957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7503-dfc9-454e-bd85-a40faa996890 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:21.162705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 898/1808] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:20 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:21.891034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35837ea8-361f-41a7-a604-19c97af7ed16 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:21.909613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:22.229546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35837ea8-361f-41a7-a604-19c97af7ed16 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.259855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.261159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.263059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.266362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] PATH_INFO: `/v3/users/bab5a1b40b434ab6bed93c0ad7961c51` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.275239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab5a1b40b434ab6bed93c0ad7961c51)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.292638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.384681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7503-dfc9-454e-bd85-a40faa996890 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.413820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7503-dfc9-454e-bd85-a40faa996890 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.427212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.430063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.430567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.431868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] PATH_INFO: `/v3/users/dcfc3da8cca746a986c955b7b764e5d2` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.433957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcfc3da8cca746a986c955b7b764e5d2)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.439955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.448590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab5a1b40b434ab6bed93c0ad7961c51'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.463629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab5a1b40b434ab6bed93c0ad7961c51'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.464874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab5a1b40b434ab6bed93c0ad7961c51'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.483396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab5a1b40b434ab6bed93c0ad7961c51'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.484184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1883ac51-d857-44c2-93ae-bec28d7be711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab5a1b40b434ab6bed93c0ad7961c51'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.536191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 911/1809] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:21 2022] DELETE /identity/v3/users/bab5a1b40b434ab6bed93c0ad7961c51 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:22.541953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab5bf-4e69-4d50-9ae1-06ac43adccaf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.542449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab5bf-4e69-4d50-9ae1-06ac43adccaf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.542741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab5bf-4e69-4d50-9ae1-06ac43adccaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.577508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6b9ab5bf-4e69-4d50-9ae1-06ac43adccaf None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:22.579894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6b9ab5bf-4e69-4d50-9ae1-06ac43adccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:22.590302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcfc3da8cca746a986c955b7b764e5d2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.607616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcfc3da8cca746a986c955b7b764e5d2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.608939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcfc3da8cca746a986c955b7b764e5d2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.622807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcfc3da8cca746a986c955b7b764e5d2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.665580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fbdbab66-b1a9-4309-8497-e8e2d87b563c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcfc3da8cca746a986c955b7b764e5d2'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.694689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 899/1810] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:22 2022] DELETE /identity/v3/users/dcfc3da8cca746a986c955b7b764e5d2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:22.702774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1c61f-67a3-4dec-8383-5f6f339dd052 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.704906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1c61f-67a3-4dec-8383-5f6f339dd052 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.705504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1c61f-67a3-4dec-8383-5f6f339dd052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.770615 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-27d1c61f-67a3-4dec-8383-5f6f339dd052 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:22.778006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 912/1811] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:22.778286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-27d1c61f-67a3-4dec-8383-5f6f339dd052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:22.786821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ab5bf-4e69-4d50-9ae1-06ac43adccaf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.787834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6b9ab5bf-4e69-4d50-9ae1-06ac43adccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:22.856449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:22.968081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ab5bf-4e69-4d50-9ae1-06ac43adccaf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.032114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 900/1812] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:23.043646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1c61f-67a3-4dec-8383-5f6f339dd052 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.115714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.116368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.116653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.116933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.120443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:23.139489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:23.141755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:23.166852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 913/1813] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:23.249539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1c61f-67a3-4dec-8383-5f6f339dd052 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.254874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.255737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.256034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.256371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.296204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:23.297504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:23.342035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 901/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:23.976978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.978680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:23.994127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173f82a-7d70-428a-99b9-ac55fd2847ad service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:24.016077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:24.017132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:24.017616 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:24.018083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] PATH_INFO: `/v3/projects/a17ccbc0b95a4792846f90d1948be512` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:24.020510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17ccbc0b95a4792846f90d1948be512)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:24.023009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:24.129703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:24.132254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:24.149930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8c7bd-d330-4c85-88e2-d17e57b69759 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:24.151465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17ccbc0b95a4792846f90d1948be512', 'request_id': 'req-7faaf483-9efa-462d-adc2-15969ee3a6f4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.173157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17ccbc0b95a4792846f90d1948be512', 'request_id': 'req-7faaf483-9efa-462d-adc2-15969ee3a6f4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.181992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17ccbc0b95a4792846f90d1948be512', 'request_id': 'req-7faaf483-9efa-462d-adc2-15969ee3a6f4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.203017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] The token cache is being invalidate because project a17ccbc0b95a4792846f90d1948be512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:24.204261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.205801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.213847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 914/1815] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:23 2022] DELETE /identity/v3/projects/a17ccbc0b95a4792846f90d1948be512 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:24.218051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:24.220096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:24.254178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:24.255248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:24.255673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:24.255827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] PATH_INFO: `/v3/projects/14771d0592024ef9921b981f22e01c08` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:24.257079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14771d0592024ef9921b981f22e01c08)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:24.259114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:24.344089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaf483-9efa-462d-adc2-15969ee3a6f4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:24.349190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14771d0592024ef9921b981f22e01c08', 'request_id': 'req-004a8ca8-9e5c-4011-9d96-543d6e566e77'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.357731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14771d0592024ef9921b981f22e01c08', 'request_id': 'req-004a8ca8-9e5c-4011-9d96-543d6e566e77'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.358581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:24.378622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14771d0592024ef9921b981f22e01c08', 'request_id': 'req-004a8ca8-9e5c-4011-9d96-543d6e566e77'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.420025 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] The token cache is being invalidate because project 14771d0592024ef9921b981f22e01c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:24.420336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.422510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.430917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 902/1816] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:24 2022] DELETE /identity/v3/projects/14771d0592024ef9921b981f22e01c08 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:24.433926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:24.438372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:24.454115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:24.454858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:24.455145 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:24.455418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] PATH_INFO: `/v3/users/5d812bbd162a461f911891ae6e4fafb6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:24.460177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d812bbd162a461f911891ae6e4fafb6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:24.464252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:24.598392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d812bbd162a461f911891ae6e4fafb6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.630972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d812bbd162a461f911891ae6e4fafb6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.633724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d812bbd162a461f911891ae6e4fafb6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.641793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a8ca8-9e5c-4011-9d96-543d6e566e77 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:24.651487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d812bbd162a461f911891ae6e4fafb6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.651707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:24.652233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:24.652387 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d812bbd162a461f911891ae6e4fafb6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.652557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:24.652848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] PATH_INFO: `/v3/users/298fe11ba1cc47d190287b3294d29a1d` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:24.655481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=298fe11ba1cc47d190287b3294d29a1d)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:24.657485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:24.665199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:24.681945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 915/1817] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:24 2022] DELETE /identity/v3/users/5d812bbd162a461f911891ae6e4fafb6 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:24.783535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298fe11ba1cc47d190287b3294d29a1d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.795175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298fe11ba1cc47d190287b3294d29a1d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.796405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298fe11ba1cc47d190287b3294d29a1d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.820983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298fe11ba1cc47d190287b3294d29a1d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.840524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298fe11ba1cc47d190287b3294d29a1d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.858771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 903/1818] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:24 2022] DELETE /identity/v3/users/298fe11ba1cc47d190287b3294d29a1d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:25.144126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.147206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.251545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe370f8-c1ed-4f8f-be5a-bb316d1a3137 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.304722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.307542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.348580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:25.403131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.404105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.404767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.405461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] PATH_INFO: `/v3/users/34c482d077e849bc9da3ef8d871285f3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.407445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c482d077e849bc9da3ef8d871285f3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.412745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.437336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27410d7c-45f8-4d5c-ab4e-f020f436bd9f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.450091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.451508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.452224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.452734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] PATH_INFO: `/v3/projects/6b9f8d6e9fed4baa8e191b04632fb3f7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.455043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9f8d6e9fed4baa8e191b04632fb3f7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.459144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.510399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c482d077e849bc9da3ef8d871285f3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.522687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c482d077e849bc9da3ef8d871285f3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.523426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c482d077e849bc9da3ef8d871285f3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.533790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c482d077e849bc9da3ef8d871285f3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.534540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c482d077e849bc9da3ef8d871285f3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.553825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9f8d6e9fed4baa8e191b04632fb3f7', 'request_id': 'req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.561563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9f8d6e9fed4baa8e191b04632fb3f7', 'request_id': 'req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.562088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 916/1819] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:25 2022] DELETE /identity/v3/users/34c482d077e849bc9da3ef8d871285f3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:25.563433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.568933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.581766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9f8d6e9fed4baa8e191b04632fb3f7', 'request_id': 'req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.603665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] The token cache is being invalidate because project 6b9f8d6e9fed4baa8e191b04632fb3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:25.604219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.605118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4b2c236b-ae58-4faa-aa11-f03a90bb7f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.609988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 904/1820] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:25 2022] DELETE /identity/v3/projects/6b9f8d6e9fed4baa8e191b04632fb3f7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:25.609988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a504f2-255e-4278-9f92-fc943e027708 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.609988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a504f2-255e-4278-9f92-fc943e027708 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.609988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a504f2-255e-4278-9f92-fc943e027708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.632556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-17a504f2-255e-4278-9f92-fc943e027708 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:25.633903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-17a504f2-255e-4278-9f92-fc943e027708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.670554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:25.674344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9167f4-0094-4a1b-bf73-9939b2c32c4f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.681845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.682545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.682836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.683118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] PATH_INFO: `/v3/projects/25388812f6014a41952732fea3358459` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.684318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25388812f6014a41952732fea3358459)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.686419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.757378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25388812f6014a41952732fea3358459', 'request_id': 'req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.767791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25388812f6014a41952732fea3358459', 'request_id': 'req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.772628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 905/1821] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:25.774219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16490f23-c28f-4b83-85f9-f10600774477 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.775105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16490f23-c28f-4b83-85f9-f10600774477 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.775612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16490f23-c28f-4b83-85f9-f10600774477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.790648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:25.793919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25388812f6014a41952732fea3358459', 'request_id': 'req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.806024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-16490f23-c28f-4b83-85f9-f10600774477 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:25.809983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-16490f23-c28f-4b83-85f9-f10600774477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.817053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] The token cache is being invalidate because project 25388812f6014a41952732fea3358459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:25.818812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.819954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.824614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 917/1822] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:25 2022] DELETE /identity/v3/projects/25388812f6014a41952732fea3358459 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:25.828588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.831094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.921548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 906/1823] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:25.922630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311e87-3662-4322-a236-6e8e4f582cbc None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.922921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311e87-3662-4322-a236-6e8e4f582cbc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.923244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af311e87-3662-4322-a236-6e8e4f582cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.940329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73b0d9-09e7-4f54-bca1-b1ae3bfa4db5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.945850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faf35e-91bf-4878-af2e-4521546128be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.946180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-af311e87-3662-4322-a236-6e8e4f582cbc None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:25.946977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf35e-91bf-4878-af2e-4521546128be service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.947332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-af311e87-3662-4322-a236-6e8e4f582cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.947465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf35e-91bf-4878-af2e-4521546128be service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.947866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf35e-91bf-4878-af2e-4521546128be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.950859 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-01faf35e-91bf-4878-af2e-4521546128be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.956042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 907/1824] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:25.957902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11201ada-dc13-4607-b104-baf395527575 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.958177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11201ada-dc13-4607-b104-baf395527575 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.958492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11201ada-dc13-4607-b104-baf395527575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.973199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf35e-91bf-4878-af2e-4521546128be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.974873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf35e-91bf-4878-af2e-4521546128be service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.984191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-11201ada-dc13-4607-b104-baf395527575 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:25.985742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 918/1825] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:25.986108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-11201ada-dc13-4607-b104-baf395527575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.987107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c56f6-1626-4790-bcc2-be63ba936077 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.987402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c56f6-1626-4790-bcc2-be63ba936077 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.987680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c56f6-1626-4790-bcc2-be63ba936077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.997986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 908/1826] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:26.002321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11201ada-dc13-4607-b104-baf395527575 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.013227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2f8c56f6-1626-4790-bcc2-be63ba936077 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:26.014090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11201ada-dc13-4607-b104-baf395527575 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.014563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f8c56f6-1626-4790-bcc2-be63ba936077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:26.019543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.020353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.020819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.021102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.021783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:26.022093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.023773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.030454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 919/1827] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:26.034554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c56f6-1626-4790-bcc2-be63ba936077 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.044179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 909/1828] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:16:26.047709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c56f6-1626-4790-bcc2-be63ba936077 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.049355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.057810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.059181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.059705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.060014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.060687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:26.060999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.062886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.068579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aace0-3220-4508-81cd-b74c1c73a1d7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.077053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e10c2-9168-4e07-9e59-135ef4270409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.078272 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e10c2-9168-4e07-9e59-135ef4270409 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.078723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e10c2-9168-4e07-9e59-135ef4270409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.079045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e10c2-9168-4e07-9e59-135ef4270409 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.079764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e10c2-9168-4e07-9e59-135ef4270409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.081449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 920/1829] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:26.086124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.086563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e10c2-9168-4e07-9e59-135ef4270409 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.107902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2bc00-e3c3-46d3-8a4e-bfc9d687b506 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.121250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76144d3d-c1a3-420b-947a-e438e5df8fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.122773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144d3d-c1a3-420b-947a-e438e5df8fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.123169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144d3d-c1a3-420b-947a-e438e5df8fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.123676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144d3d-c1a3-420b-947a-e438e5df8fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.125088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76144d3d-c1a3-420b-947a-e438e5df8fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.131594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76144d3d-c1a3-420b-947a-e438e5df8fb1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.157269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 910/1830] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:26 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:26.162548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e10c2-9168-4e07-9e59-135ef4270409 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.197011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 921/1831] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:26 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:26.201431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76144d3d-c1a3-420b-947a-e438e5df8fb1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.274893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e10c2-9168-4e07-9e59-135ef4270409 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.294055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76144d3d-c1a3-420b-947a-e438e5df8fb1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.303242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:26.306438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df024aa-b116-4576-ae8c-4e6239d7525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.307084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df024aa-b116-4576-ae8c-4e6239d7525b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.307368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df024aa-b116-4576-ae8c-4e6239d7525b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.307650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df024aa-b116-4576-ae8c-4e6239d7525b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.308300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df024aa-b116-4576-ae8c-4e6239d7525b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.310856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df024aa-b116-4576-ae8c-4e6239d7525b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.364602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 922/1832] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:26 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:26.369058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df024aa-b116-4576-ae8c-4e6239d7525b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.393524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df024aa-b116-4576-ae8c-4e6239d7525b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.403390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd6d38-cab4-4282-9c39-eb2e3c1ada85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.404614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6d38-cab4-4282-9c39-eb2e3c1ada85 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.405132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6d38-cab4-4282-9c39-eb2e3c1ada85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.405708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd6d38-cab4-4282-9c39-eb2e3c1ada85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.407079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd6d38-cab4-4282-9c39-eb2e3c1ada85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.410018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd6d38-cab4-4282-9c39-eb2e3c1ada85 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.436410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 923/1833] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:26.448263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd6d38-cab4-4282-9c39-eb2e3c1ada85 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.477639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd6d38-cab4-4282-9c39-eb2e3c1ada85 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.486394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca0119-3bf5-4dd9-a90f-1d67cfcd0a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.488154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0119-3bf5-4dd9-a90f-1d67cfcd0a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.488926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0119-3bf5-4dd9-a90f-1d67cfcd0a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.489247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8279-9bd9-4599-b5a2-7844940d08c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.489709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0119-3bf5-4dd9-a90f-1d67cfcd0a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.490366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8279-9bd9-4599-b5a2-7844940d08c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.490872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8279-9bd9-4599-b5a2-7844940d08c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.490977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca0119-3bf5-4dd9-a90f-1d67cfcd0a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.491538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8279-9bd9-4599-b5a2-7844940d08c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.492701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8279-9bd9-4599-b5a2-7844940d08c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.494552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca0119-3bf5-4dd9-a90f-1d67cfcd0a7f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.497297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8279-9bd9-4599-b5a2-7844940d08c8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.522056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 924/1834] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:26.527667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca0119-3bf5-4dd9-a90f-1d67cfcd0a7f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.544611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 911/1835] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:26 2022] POST /identity/v3/users => generated 286 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:26.548727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca0119-3bf5-4dd9-a90f-1d67cfcd0a7f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.549380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8279-9bd9-4599-b5a2-7844940d08c8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.571278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.572406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.573014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.573512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] PATH_INFO: `/v3/projects/136b69e3b14b47799003caecde8f88e5/users/ec61fae235884df881bf03c6a5a73901/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.576091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8279-9bd9-4599-b5a2-7844940d08c8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.590940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.591580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.591864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.592214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.592814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.594541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.604380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:26.612330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136b69e3b14b47799003caecde8f88e5, user_id=ec61fae235884df881bf03c6a5a73901, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.617020 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.622280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 912/1836] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:26.622280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.622765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:26.639327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af7f0-96de-4481-ab79-0366c34ed1f4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.651229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 925/1837] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:26 2022] PUT /identity/v3/projects/136b69e3b14b47799003caecde8f88e5/users/ec61fae235884df881bf03c6a5a73901/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:26.656455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.662826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:26.738678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.739987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.740600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.741298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] PATH_INFO: `/v3/users/a38e947d7cad4e4d80a92c6ba1485d8e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.743436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38e947d7cad4e4d80a92c6ba1485d8e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.747363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.812582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e0e02-cef1-42c7-a1ed-8d93efed3047 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.821252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.822048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.822443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.822792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] PATH_INFO: `/v3/projects/c798be95a56943d6b2855fee7d752fe4` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.824318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c798be95a56943d6b2855fee7d752fe4)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.826651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.841962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38e947d7cad4e4d80a92c6ba1485d8e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.856882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38e947d7cad4e4d80a92c6ba1485d8e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.866857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38e947d7cad4e4d80a92c6ba1485d8e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.881913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38e947d7cad4e4d80a92c6ba1485d8e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.902414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38e947d7cad4e4d80a92c6ba1485d8e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.911622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 913/1838] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:26 2022] DELETE /identity/v3/users/a38e947d7cad4e4d80a92c6ba1485d8e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:26.912606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.914014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:26.925463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c798be95a56943d6b2855fee7d752fe4', 'request_id': 'req-9fd96de0-0408-41a1-b30f-c337bb54ce63'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.936411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:26.942971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c798be95a56943d6b2855fee7d752fe4', 'request_id': 'req-9fd96de0-0408-41a1-b30f-c337bb54ce63'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.958488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c798be95a56943d6b2855fee7d752fe4', 'request_id': 'req-9fd96de0-0408-41a1-b30f-c337bb54ce63'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.006298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] The token cache is being invalidate because project c798be95a56943d6b2855fee7d752fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:27.006298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.006298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9fd96de0-0408-41a1-b30f-c337bb54ce63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.006298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 926/1839] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:26 2022] DELETE /identity/v3/projects/c798be95a56943d6b2855fee7d752fe4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:27.006298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429554-db6f-4b60-9516-3025f01f423c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.007132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429554-db6f-4b60-9516-3025f01f423c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.007132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429554-db6f-4b60-9516-3025f01f423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.015256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710568-82c5-4a74-9f24-1a129d008259 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.021847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb63ddc-98cb-46f8-9d29-f66c8bc556f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.022759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb63ddc-98cb-46f8-9d29-f66c8bc556f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.023068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb63ddc-98cb-46f8-9d29-f66c8bc556f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.023399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb63ddc-98cb-46f8-9d29-f66c8bc556f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.024394 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb63ddc-98cb-46f8-9d29-f66c8bc556f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.026182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb63ddc-98cb-46f8-9d29-f66c8bc556f8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.048243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 914/1840] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:27.048720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-05429554-db6f-4b60-9516-3025f01f423c None None] MFA Rules not processed for user `ec61fae235884df881bf03c6a5a73901`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:27.049744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b325a5-dd50-425d-8279-d7911dfade54 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.050038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b325a5-dd50-425d-8279-d7911dfade54 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.050345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b325a5-dd50-425d-8279-d7911dfade54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.051553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-05429554-db6f-4b60-9516-3025f01f423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.077891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a0b325a5-dd50-425d-8279-d7911dfade54 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:27.079172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a0b325a5-dd50-425d-8279-d7911dfade54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.087746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 915/1841] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:27.089206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b325a5-dd50-425d-8279-d7911dfade54 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.091213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a0b325a5-dd50-425d-8279-d7911dfade54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.105032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b325a5-dd50-425d-8279-d7911dfade54 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.110418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.111071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.111352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.111629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] PATH_INFO: `/v3/users/a13e3dddecfd4dfe982534eed31f89c7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.112870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13e3dddecfd4dfe982534eed31f89c7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.115493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.167060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 927/1842] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:27.168076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429554-db6f-4b60-9516-3025f01f423c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.169467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-05429554-db6f-4b60-9516-3025f01f423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.181956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13e3dddecfd4dfe982534eed31f89c7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.184180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429554-db6f-4b60-9516-3025f01f423c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.189226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.189979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.190277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.190576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] PATH_INFO: `/v3/projects/bb057c74fa2c4a3cb5be2bff358f37b4/users/4fac14b657fb49df957ff5fbf5d24cc6/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.196350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13e3dddecfd4dfe982534eed31f89c7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.197557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13e3dddecfd4dfe982534eed31f89c7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.203699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:27.209163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13e3dddecfd4dfe982534eed31f89c7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.213791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb057c74fa2c4a3cb5be2bff358f37b4, user_id=4fac14b657fb49df957ff5fbf5d24cc6, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.217080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.227407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13e3dddecfd4dfe982534eed31f89c7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.235700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 928/1843] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:27 2022] PUT /identity/v3/projects/bb057c74fa2c4a3cb5be2bff358f37b4/users/4fac14b657fb49df957ff5fbf5d24cc6/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:27.235987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 916/1844] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:27 2022] DELETE /identity/v3/users/a13e3dddecfd4dfe982534eed31f89c7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:27.236251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.236885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.238646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.239348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.314386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5357137-289f-4610-8281-d222876c9d8e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.350354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380951b-f317-4ef7-b063-2707d70fb5a1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.358208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b55e5-3d1b-4cdd-915e-dd8ae9ee29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.359102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b55e5-3d1b-4cdd-915e-dd8ae9ee29e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.359385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b55e5-3d1b-4cdd-915e-dd8ae9ee29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.360420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b55e5-3d1b-4cdd-915e-dd8ae9ee29e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.360863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b55e5-3d1b-4cdd-915e-dd8ae9ee29e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.364677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b55e5-3d1b-4cdd-915e-dd8ae9ee29e4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.388015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.388673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.389097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.389382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.391522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:27.396696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.401699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 917/1845] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:27.402914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372218b1-f225-45fb-bc01-cdcd145382b5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.403297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372218b1-f225-45fb-bc01-cdcd145382b5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.403669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372218b1-f225-45fb-bc01-cdcd145382b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.430282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.432076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.443891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-372218b1-f225-45fb-bc01-cdcd145382b5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:27.447193 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-372218b1-f225-45fb-bc01-cdcd145382b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.456488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 929/1846] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:27.459093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.480304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22580-3739-495a-9aaa-c068571d7efd service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.577603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 918/1847] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:27.596654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372218b1-f225-45fb-bc01-cdcd145382b5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.601598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-372218b1-f225-45fb-bc01-cdcd145382b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.610444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.611259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.611569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.611957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.612648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.616749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.672515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 930/1848] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:27.674630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.686908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.703097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65b183-8f15-453e-8715-79215a087381 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.708835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.709657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.710172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.710578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] PATH_INFO: `/v3/projects/e0d11bd831e54d608f023e950242df39` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.711938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d11bd831e54d608f023e950242df39)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.714193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.766137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372218b1-f225-45fb-bc01-cdcd145382b5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.771397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc23e6c-0b9e-4d99-88a1-521585bc0e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.772109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23e6c-0b9e-4d99-88a1-521585bc0e79 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.772470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23e6c-0b9e-4d99-88a1-521585bc0e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.773661 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23e6c-0b9e-4d99-88a1-521585bc0e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.785627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc23e6c-0b9e-4d99-88a1-521585bc0e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.787824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc23e6c-0b9e-4d99-88a1-521585bc0e79 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.789994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:27.799874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 919/1849] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:27.801304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc23e6c-0b9e-4d99-88a1-521585bc0e79 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.812278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc23e6c-0b9e-4d99-88a1-521585bc0e79 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.814030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d11bd831e54d608f023e950242df39', 'request_id': 'req-8e7f13c7-074f-4e87-a512-993f3f2fad51'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.825652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d11bd831e54d608f023e950242df39', 'request_id': 'req-8e7f13c7-074f-4e87-a512-993f3f2fad51'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.836469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d11bd831e54d608f023e950242df39', 'request_id': 'req-8e7f13c7-074f-4e87-a512-993f3f2fad51'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.854642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] The token cache is being invalidate because project e0d11bd831e54d608f023e950242df39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:27.855039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.855795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8e7f13c7-074f-4e87-a512-993f3f2fad51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.858660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 931/1850] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:27 2022] DELETE /identity/v3/projects/e0d11bd831e54d608f023e950242df39 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:27.864463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb0687-cd08-4b0e-a8c0-28c16ae1965c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.864463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb0687-cd08-4b0e-a8c0-28c16ae1965c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.864820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb0687-cd08-4b0e-a8c0-28c16ae1965c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.902790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1bbb0687-cd08-4b0e-a8c0-28c16ae1965c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:27.905105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.905626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1bbb0687-cd08-4b0e-a8c0-28c16ae1965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.905807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.906064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.906474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.907133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.909401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.923956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 932/1851] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:27.924151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 920/1852] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:27.926738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056827c-2487-4d62-9cf8-fdd948c48cf7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.926936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.927220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056827c-2487-4d62-9cf8-fdd948c48cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.927573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056827c-2487-4d62-9cf8-fdd948c48cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.929213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.949536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab64c73-abcd-42d4-839b-7932219634a2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.960673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dfd68-2687-46f3-80ef-6836b72748fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.962075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dfd68-2687-46f3-80ef-6836b72748fb admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.962923 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dfd68-2687-46f3-80ef-6836b72748fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.963515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dfd68-2687-46f3-80ef-6836b72748fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.964561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dfd68-2687-46f3-80ef-6836b72748fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.966328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dfd68-2687-46f3-80ef-6836b72748fb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.972390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8056827c-2487-4d62-9cf8-fdd948c48cf7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:27.974211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8056827c-2487-4d62-9cf8-fdd948c48cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.990014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 921/1853] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:27.996933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 933/1854] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:27.998271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dfd68-2687-46f3-80ef-6836b72748fb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.999405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056827c-2487-4d62-9cf8-fdd948c48cf7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.011989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056827c-2487-4d62-9cf8-fdd948c48cf7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.017872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d89a3-2d78-4dca-968c-687cfe7e8c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.018954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d89a3-2d78-4dca-968c-687cfe7e8c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.019338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d89a3-2d78-4dca-968c-687cfe7e8c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.019680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d89a3-2d78-4dca-968c-687cfe7e8c5f admin admin] PATH_INFO: `/v3/projects/f6e340b7fdf54577b850868b386e4da9/users/055e5fd7b94541da83fe2a019c84464b/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.045224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dfd68-2687-46f3-80ef-6836b72748fb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.053370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.054102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.054441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.054718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.055519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:28.056058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.057868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.079659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 922/1855] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:28.081031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.085662 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.109739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b68d0-4bcb-402b-81d0-658faf9ad848 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.110784 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d89a3-2d78-4dca-968c-687cfe7e8c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e340b7fdf54577b850868b386e4da9, user_id=055e5fd7b94541da83fe2a019c84464b, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.130188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d89a3-2d78-4dca-968c-687cfe7e8c5f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.149465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.150521 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.150966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.151332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] PATH_INFO: `/v3/projects/baac1ae747b943ce86a5ac86859c44ce` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.153229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=baac1ae747b943ce86a5ac86859c44ce)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.158304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.159372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 934/1856] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:27 2022] PUT /identity/v3/projects/f6e340b7fdf54577b850868b386e4da9/users/055e5fd7b94541da83fe2a019c84464b/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:28.161061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d89a3-2d78-4dca-968c-687cfe7e8c5f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.184445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:28.257192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d89a3-2d78-4dca-968c-687cfe7e8c5f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.269049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baac1ae747b943ce86a5ac86859c44ce', 'request_id': 'req-0d032155-1930-4f73-a9f2-a0e015c5b09c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.279875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baac1ae747b943ce86a5ac86859c44ce', 'request_id': 'req-0d032155-1930-4f73-a9f2-a0e015c5b09c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.292508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baac1ae747b943ce86a5ac86859c44ce', 'request_id': 'req-0d032155-1930-4f73-a9f2-a0e015c5b09c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.308455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] The token cache is being invalidate because project baac1ae747b943ce86a5ac86859c44ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:28.308811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.309430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0d032155-1930-4f73-a9f2-a0e015c5b09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.314781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 923/1857] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:28 2022] DELETE /identity/v3/projects/baac1ae747b943ce86a5ac86859c44ce => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:28.316472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe3fa-2418-43e8-9751-d7b0e6e4b14c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.316759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe3fa-2418-43e8-9751-d7b0e6e4b14c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.317135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe3fa-2418-43e8-9751-d7b0e6e4b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.354296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f5dfe3fa-2418-43e8-9751-d7b0e6e4b14c None None] MFA Rules not processed for user `055e5fd7b94541da83fe2a019c84464b`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:28.355567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f5dfe3fa-2418-43e8-9751-d7b0e6e4b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.382702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.384043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.384660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.385612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.386572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.388951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.435878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 935/1858] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:28 2022] POST /identity/v3/projects => generated 355 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:28.442425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.451218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.475407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 924/1859] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:28.477071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe3fa-2418-43e8-9751-d7b0e6e4b14c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.482903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f5dfe3fa-2418-43e8-9751-d7b0e6e4b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.492094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:28.526950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe3fa-2418-43e8-9751-d7b0e6e4b14c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.641232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c2afd-5f5f-49be-b144-c0a11285ff2b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.641497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.642585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.643133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.643794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.646034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.649230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.649606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.650331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.650809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.651252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] PATH_INFO: `/v3/users/f82d2bb20b38430fa408957807930b95` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.653102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82d2bb20b38430fa408957807930b95)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.656645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.690466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 925/1860] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:28 2022] POST /identity/v3/users => generated 278 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:28.690466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.694144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.726903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9f92-a357-41b2-bfa9-6ca294849266 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.736306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.737675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.738655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82d2bb20b38430fa408957807930b95'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.739126 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.739495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.740163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.742771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.748285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82d2bb20b38430fa408957807930b95'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.749523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82d2bb20b38430fa408957807930b95'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.762913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:28.763830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82d2bb20b38430fa408957807930b95'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.765625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82d2bb20b38430fa408957807930b95'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.786309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 926/1861] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:28 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:28.788055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.789902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.828463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 936/1862] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:28 2022] DELETE /identity/v3/users/f82d2bb20b38430fa408957807930b95 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:28.832381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.834858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.882168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a777aa-1d5f-489c-9238-92a3407c0c90 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.997228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7994acd-d999-408e-9b6d-c5d3f19ea6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.997980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994acd-d999-408e-9b6d-c5d3f19ea6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.998293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994acd-d999-408e-9b6d-c5d3f19ea6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.998590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7994acd-d999-408e-9b6d-c5d3f19ea6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.999261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7994acd-d999-408e-9b6d-c5d3f19ea6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.001000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7994acd-d999-408e-9b6d-c5d3f19ea6e8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.020945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 927/1863] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:29.022681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b9933-892a-4371-adee-230bc05ed86c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.022964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b9933-892a-4371-adee-230bc05ed86c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.023249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b9933-892a-4371-adee-230bc05ed86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.048503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aaba0-52b9-49b6-bd05-a31e9704d9ee admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.057828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c68b9933-892a-4371-adee-230bc05ed86c None None] MFA Rules not processed for user `4fac14b657fb49df957ff5fbf5d24cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:29.059120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c68b9933-892a-4371-adee-230bc05ed86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.062386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654d61-5ed1-480b-bcd0-00a217b3c02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.062727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654d61-5ed1-480b-bcd0-00a217b3c02a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.063021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654d61-5ed1-480b-bcd0-00a217b3c02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.063295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654d61-5ed1-480b-bcd0-00a217b3c02a admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.064458 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60654d61-5ed1-480b-bcd0-00a217b3c02a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.065940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60654d61-5ed1-480b-bcd0-00a217b3c02a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.109451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 937/1864] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:28 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:29.110352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654d61-5ed1-480b-bcd0-00a217b3c02a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.138466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 928/1865] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:29.139296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b9933-892a-4371-adee-230bc05ed86c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.139510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654d61-5ed1-480b-bcd0-00a217b3c02a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.151616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b9933-892a-4371-adee-230bc05ed86c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.156919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.157514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.157796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.158076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.158802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.161230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.162363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea257e-4102-4ad6-80d8-e768a82c3f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.163021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea257e-4102-4ad6-80d8-e768a82c3f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.163311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea257e-4102-4ad6-80d8-e768a82c3f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.163680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea257e-4102-4ad6-80d8-e768a82c3f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.164254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea257e-4102-4ad6-80d8-e768a82c3f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.165943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea257e-4102-4ad6-80d8-e768a82c3f6b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.174031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 929/1866] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:29.177362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.179635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.195527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 938/1867] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:29.210293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea257e-4102-4ad6-80d8-e768a82c3f6b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.210891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea257e-4102-4ad6-80d8-e768a82c3f6b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.211953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e7396-4013-44d9-8548-2647f8847695 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.220352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9114d-f8c0-468d-b320-de4c00c90207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.221150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9114d-f8c0-468d-b320-de4c00c90207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.221482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9114d-f8c0-468d-b320-de4c00c90207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.221706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9114d-f8c0-468d-b320-de4c00c90207 admin admin] PATH_INFO: `/v3/projects/fcc85b3c767c40e8abba31da8d9ca9b7/users/c2c2cf2914a64a3fa2e88b23fcdde8ee/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.224294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab645e-325b-4797-8f61-b6730edf8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.225186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab645e-325b-4797-8f61-b6730edf8528 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.225897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab645e-325b-4797-8f61-b6730edf8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.225897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab645e-325b-4797-8f61-b6730edf8528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.232850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab645e-325b-4797-8f61-b6730edf8528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.233528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:29.235615 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab645e-325b-4797-8f61-b6730edf8528 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.244900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9114d-f8c0-468d-b320-de4c00c90207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc85b3c767c40e8abba31da8d9ca9b7, user_id=c2c2cf2914a64a3fa2e88b23fcdde8ee, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.249831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9114d-f8c0-468d-b320-de4c00c90207 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.268524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 939/1868] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:29 2022] PUT /identity/v3/projects/fcc85b3c767c40e8abba31da8d9ca9b7/users/c2c2cf2914a64a3fa2e88b23fcdde8ee/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:29.269872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9114d-f8c0-468d-b320-de4c00c90207 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.272696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:29.296936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 930/1869] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:29.296936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab645e-325b-4797-8f61-b6730edf8528 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.373100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9114d-f8c0-468d-b320-de4c00c90207 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.440379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab645e-325b-4797-8f61-b6730edf8528 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.446678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f8fdf-4b84-4df3-bd5f-8368b6e7f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.447326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f8fdf-4b84-4df3-bd5f-8368b6e7f6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.447608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f8fdf-4b84-4df3-bd5f-8368b6e7f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.447889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f8fdf-4b84-4df3-bd5f-8368b6e7f6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.448566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f8fdf-4b84-4df3-bd5f-8368b6e7f6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.450170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f8fdf-4b84-4df3-bd5f-8368b6e7f6c3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.459762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295a7d9-94ae-4124-9a0f-169ba47d3c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.461013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295a7d9-94ae-4124-9a0f-169ba47d3c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.467910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 931/1870] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:29.467910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f8fdf-4b84-4df3-bd5f-8368b6e7f6c3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.470855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295a7d9-94ae-4124-9a0f-169ba47d3c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.471193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295a7d9-94ae-4124-9a0f-169ba47d3c50 admin admin] PATH_INFO: `/v3/projects/b5a5170f0907491ebda6ed5f30ef9de2/users/be1db1c8d12a402ab74df1e387705e7e/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.487178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f8fdf-4b84-4df3-bd5f-8368b6e7f6c3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.492698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.493328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.493613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.493890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.494582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.496540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.497258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295a7d9-94ae-4124-9a0f-169ba47d3c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a5170f0907491ebda6ed5f30ef9de2, user_id=be1db1c8d12a402ab74df1e387705e7e, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.503888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295a7d9-94ae-4124-9a0f-169ba47d3c50 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.524426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 932/1871] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/users => generated 291 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:29.528247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.528669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 940/1872] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:29 2022] PUT /identity/v3/projects/b5a5170f0907491ebda6ed5f30ef9de2/users/be1db1c8d12a402ab74df1e387705e7e/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:29.529817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295a7d9-94ae-4124-9a0f-169ba47d3c50 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.530245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.544428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4251de8-1464-4b52-9927-644f347d3bf7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.621699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.622513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.622890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.623057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] PATH_INFO: `/v3/projects/6c1de16cdda5465c86e76ab389e7d9a0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.624508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1de16cdda5465c86e76ab389e7d9a0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.626573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.629650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295a7d9-94ae-4124-9a0f-169ba47d3c50 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.637691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65840895-313d-486e-81b2-794f7ea44627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.638906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65840895-313d-486e-81b2-794f7ea44627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.639407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65840895-313d-486e-81b2-794f7ea44627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.639954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65840895-313d-486e-81b2-794f7ea44627 admin admin] PATH_INFO: `/v3/projects/fcc85b3c767c40e8abba31da8d9ca9b7/users/c2c2cf2914a64a3fa2e88b23fcdde8ee/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.645331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65840895-313d-486e-81b2-794f7ea44627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc85b3c767c40e8abba31da8d9ca9b7, user_id=c2c2cf2914a64a3fa2e88b23fcdde8ee, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.650449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65840895-313d-486e-81b2-794f7ea44627 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.670337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 941/1873] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:29 2022] PUT /identity/v3/projects/fcc85b3c767c40e8abba31da8d9ca9b7/users/c2c2cf2914a64a3fa2e88b23fcdde8ee/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:29.671379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65840895-313d-486e-81b2-794f7ea44627 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.691968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1de16cdda5465c86e76ab389e7d9a0', 'request_id': 'req-7f686fca-b242-4a12-a408-71e04dfea5d4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.702765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1de16cdda5465c86e76ab389e7d9a0', 'request_id': 'req-7f686fca-b242-4a12-a408-71e04dfea5d4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.703676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:29.712533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1de16cdda5465c86e76ab389e7d9a0', 'request_id': 'req-7f686fca-b242-4a12-a408-71e04dfea5d4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.728254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] The token cache is being invalidate because project 6c1de16cdda5465c86e76ab389e7d9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:29.728552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.729266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f686fca-b242-4a12-a408-71e04dfea5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.731410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 933/1874] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:29 2022] DELETE /identity/v3/projects/6c1de16cdda5465c86e76ab389e7d9a0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:29.732463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefddd7-4beb-43d9-afe2-6261d1349a65 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.732753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefddd7-4beb-43d9-afe2-6261d1349a65 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.733033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefddd7-4beb-43d9-afe2-6261d1349a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.748468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:29.770609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8fefddd7-4beb-43d9-afe2-6261d1349a65 None None] MFA Rules not processed for user `be1db1c8d12a402ab74df1e387705e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:29.772005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8fefddd7-4beb-43d9-afe2-6261d1349a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.786828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65840895-313d-486e-81b2-794f7ea44627 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.851467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17612a8-c320-4ee3-b21e-16db22e0a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.851922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 934/1875] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:29.852094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17612a8-c320-4ee3-b21e-16db22e0a434 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.852367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17612a8-c320-4ee3-b21e-16db22e0a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.852747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17612a8-c320-4ee3-b21e-16db22e0a434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.853437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17612a8-c320-4ee3-b21e-16db22e0a434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.855174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17612a8-c320-4ee3-b21e-16db22e0a434 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.856162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ae09-c4a3-4b7c-b21f-e64912274697 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.856604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ae09-c4a3-4b7c-b21f-e64912274697 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.856975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ae09-c4a3-4b7c-b21f-e64912274697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.866162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 942/1876] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:29.867693 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1197-4930-49d5-ad22-3c72e620c375 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.867980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1197-4930-49d5-ad22-3c72e620c375 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.868260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1197-4930-49d5-ad22-3c72e620c375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.892594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-73af1197-4930-49d5-ad22-3c72e620c375 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:29.894881 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-73af1197-4930-49d5-ad22-3c72e620c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.896496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5481ae09-c4a3-4b7c-b21f-e64912274697 None None] MFA Rules not processed for user `c2c2cf2914a64a3fa2e88b23fcdde8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:29.897751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5481ae09-c4a3-4b7c-b21f-e64912274697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.908532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 943/1877] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:29.909545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af1197-4930-49d5-ad22-3c72e620c375 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.911485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-73af1197-4930-49d5-ad22-3c72e620c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.927735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af1197-4930-49d5-ad22-3c72e620c375 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.933664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.934438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.934955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.935418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.936277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.938634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.985159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 944/1878] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/projects => generated 357 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:29.986317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.988867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.989756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 935/1879] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:29.991201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ac64-1445-4aea-b995-91b0caf981ce None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.991729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ac64-1445-4aea-b995-91b0caf981ce None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.992074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6ac64-1445-4aea-b995-91b0caf981ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.015567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d9d6ac64-1445-4aea-b995-91b0caf981ce None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:30.016916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d9d6ac64-1445-4aea-b995-91b0caf981ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:30.096654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92dfa5-46cc-4c2b-9785-78f6687a3bed admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.102300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.103253 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.103527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.103876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] PATH_INFO: `/v3/projects/714ea1ecaf114266bcf83bdf55b9edfa/users/df3af1f2ed0b40a9a85441307ac26fd4/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.122366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] RBAC: Authorizing `identity:create_grant(project_id=714ea1ecaf114266bcf83bdf55b9edfa, user_id=df3af1f2ed0b40a9a85441307ac26fd4, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.125061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.141163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 936/1880] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:30.141163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6ac64-1445-4aea-b995-91b0caf981ce None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.143229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 945/1881] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:29 2022] PUT /identity/v3/projects/714ea1ecaf114266bcf83bdf55b9edfa/users/df3af1f2ed0b40a9a85441307ac26fd4/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:30.145217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.147915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:30.152045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6ac64-1445-4aea-b995-91b0caf981ce None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.164410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:30.166664 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:30.227096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b020b-0540-4a73-8ed3-dfcac768163f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.227239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da673a-567a-4cde-8f8b-d270ee4d8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.227885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da673a-567a-4cde-8f8b-d270ee4d8298 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.228188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da673a-567a-4cde-8f8b-d270ee4d8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.228443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da673a-567a-4cde-8f8b-d270ee4d8298 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.229084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da673a-567a-4cde-8f8b-d270ee4d8298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.231318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da673a-567a-4cde-8f8b-d270ee4d8298 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.232732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd5a4-457a-487b-9e68-0031df973420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.233709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd5a4-457a-487b-9e68-0031df973420 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.234089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd5a4-457a-487b-9e68-0031df973420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.234348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd5a4-457a-487b-9e68-0031df973420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.265535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 937/1882] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:30 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:30.266650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da673a-567a-4cde-8f8b-d270ee4d8298 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.277873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da673a-567a-4cde-8f8b-d270ee4d8298 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.284609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.285266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.286406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.286760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.287392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:30.287698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.291543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.306862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 938/1883] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:30.307886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.317607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd5a4-457a-487b-9e68-0031df973420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.319186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd5a4-457a-487b-9e68-0031df973420 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.319678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76a17-6533-4808-807f-879ee5c081b8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.329323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5d96a-3757-412e-af7e-70285796b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.330525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d96a-3757-412e-af7e-70285796b066 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.331027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d96a-3757-412e-af7e-70285796b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.331808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d96a-3757-412e-af7e-70285796b066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.331916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 946/1884] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:30.333008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5d96a-3757-412e-af7e-70285796b066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.333126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd5a4-457a-487b-9e68-0031df973420 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.336835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5d96a-3757-412e-af7e-70285796b066 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.345767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd5a4-457a-487b-9e68-0031df973420 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.351933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d64c6f-e1ad-4c45-9bb3-ef75ee75306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.354413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64c6f-e1ad-4c45-9bb3-ef75ee75306e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.354704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64c6f-e1ad-4c45-9bb3-ef75ee75306e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.354989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64c6f-e1ad-4c45-9bb3-ef75ee75306e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.355852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d64c6f-e1ad-4c45-9bb3-ef75ee75306e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.357755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d64c6f-e1ad-4c45-9bb3-ef75ee75306e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.362744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 939/1885] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:30.364902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5d96a-3757-412e-af7e-70285796b066 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.377165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 947/1886] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:30.377165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d64c6f-e1ad-4c45-9bb3-ef75ee75306e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.383149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5d96a-3757-412e-af7e-70285796b066 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.402175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344b3c-5d8a-4c25-adff-9167662110b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.402175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344b3c-5d8a-4c25-adff-9167662110b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.402175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344b3c-5d8a-4c25-adff-9167662110b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.402825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d64c6f-e1ad-4c45-9bb3-ef75ee75306e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.402928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344b3c-5d8a-4c25-adff-9167662110b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.402928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b344b3c-5d8a-4c25-adff-9167662110b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.402928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b344b3c-5d8a-4c25-adff-9167662110b1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.407646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b93608-7a33-48bc-9c93-dbed140740e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.408741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b93608-7a33-48bc-9c93-dbed140740e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.409300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b93608-7a33-48bc-9c93-dbed140740e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.409747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b93608-7a33-48bc-9c93-dbed140740e8 admin admin] PATH_INFO: `/v3/projects/714ea1ecaf114266bcf83bdf55b9edfa/users/df3af1f2ed0b40a9a85441307ac26fd4/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.415177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b93608-7a33-48bc-9c93-dbed140740e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714ea1ecaf114266bcf83bdf55b9edfa, user_id=df3af1f2ed0b40a9a85441307ac26fd4, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.418981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b93608-7a33-48bc-9c93-dbed140740e8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.433880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 948/1887] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:30 2022] PUT /identity/v3/projects/714ea1ecaf114266bcf83bdf55b9edfa/users/df3af1f2ed0b40a9a85441307ac26fd4/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:30.435181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b93608-7a33-48bc-9c93-dbed140740e8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.458060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 940/1888] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:30 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:30.464137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344b3c-5d8a-4c25-adff-9167662110b1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.592855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b93608-7a33-48bc-9c93-dbed140740e8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.617020 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344b3c-5d8a-4c25-adff-9167662110b1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.633449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaef3ee-f5d1-4726-aef7-5f69c442d722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.633449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaef3ee-f5d1-4726-aef7-5f69c442d722 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.633449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaef3ee-f5d1-4726-aef7-5f69c442d722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.633449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaef3ee-f5d1-4726-aef7-5f69c442d722 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.633984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaef3ee-f5d1-4726-aef7-5f69c442d722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.633984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaef3ee-f5d1-4726-aef7-5f69c442d722 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.677330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 941/1889] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:30 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:30.682027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaef3ee-f5d1-4726-aef7-5f69c442d722 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.686841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:30.699516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaef3ee-f5d1-4726-aef7-5f69c442d722 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.705773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab097f6-fde4-42ea-9ce9-e885b623ca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.706715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab097f6-fde4-42ea-9ce9-e885b623ca21 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.707330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab097f6-fde4-42ea-9ce9-e885b623ca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.707788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab097f6-fde4-42ea-9ce9-e885b623ca21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.709021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab097f6-fde4-42ea-9ce9-e885b623ca21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.712041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab097f6-fde4-42ea-9ce9-e885b623ca21 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.717080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452819-7f3a-4a8f-80b0-0d30206fc919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.717795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452819-7f3a-4a8f-80b0-0d30206fc919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.719354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452819-7f3a-4a8f-80b0-0d30206fc919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.719957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452819-7f3a-4a8f-80b0-0d30206fc919 admin admin] PATH_INFO: `/v3/projects/83820ea566f04404a814af603a12a8ba/users/5cdb2194a63045cabe6786a014277d89/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.733131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 942/1890] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:30.737014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab097f6-fde4-42ea-9ce9-e885b623ca21 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.745314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59452819-7f3a-4a8f-80b0-0d30206fc919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83820ea566f04404a814af603a12a8ba, user_id=5cdb2194a63045cabe6786a014277d89, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.748659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59452819-7f3a-4a8f-80b0-0d30206fc919 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.763257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab097f6-fde4-42ea-9ce9-e885b623ca21 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.772487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 949/1891] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:30 2022] PUT /identity/v3/projects/83820ea566f04404a814af603a12a8ba/users/5cdb2194a63045cabe6786a014277d89/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:30.778301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452819-7f3a-4a8f-80b0-0d30206fc919 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.834396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:30.871651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186aa3a-39f0-48e6-917a-7779d04a87a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.872620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186aa3a-39f0-48e6-917a-7779d04a87a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.873105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186aa3a-39f0-48e6-917a-7779d04a87a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.873567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186aa3a-39f0-48e6-917a-7779d04a87a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.874708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186aa3a-39f0-48e6-917a-7779d04a87a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.877204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186aa3a-39f0-48e6-917a-7779d04a87a6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.903974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 943/1892] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:30.904243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452819-7f3a-4a8f-80b0-0d30206fc919 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.905410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186aa3a-39f0-48e6-917a-7779d04a87a6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.914153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a352ba-f913-4d8f-9ff9-dd862a7d256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.916325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a352ba-f913-4d8f-9ff9-dd862a7d256a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.916962 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a352ba-f913-4d8f-9ff9-dd862a7d256a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.917776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a352ba-f913-4d8f-9ff9-dd862a7d256a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.919068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a352ba-f913-4d8f-9ff9-dd862a7d256a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.923013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a352ba-f913-4d8f-9ff9-dd862a7d256a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.928577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186aa3a-39f0-48e6-917a-7779d04a87a6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.938294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49096f4-fca8-42fa-addc-98265a980892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.939548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49096f4-fca8-42fa-addc-98265a980892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.940059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49096f4-fca8-42fa-addc-98265a980892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.940570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49096f4-fca8-42fa-addc-98265a980892 admin admin] PATH_INFO: `/v3/projects/b9e8f6f5c0634b42ae983eced9374cbc/users/aa97f5747b414c56ae81db1e72d05cec/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.943830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 950/1893] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:30.948062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a352ba-f913-4d8f-9ff9-dd862a7d256a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.959696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a352ba-f913-4d8f-9ff9-dd862a7d256a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.965793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79072025-21bb-4e4f-a2da-b96edaf3197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.966700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79072025-21bb-4e4f-a2da-b96edaf3197a admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.967107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79072025-21bb-4e4f-a2da-b96edaf3197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.967476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79072025-21bb-4e4f-a2da-b96edaf3197a admin admin] PATH_INFO: `/v3/projects/83820ea566f04404a814af603a12a8ba/users/5cdb2194a63045cabe6786a014277d89/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.970469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49096f4-fca8-42fa-addc-98265a980892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e8f6f5c0634b42ae983eced9374cbc, user_id=aa97f5747b414c56ae81db1e72d05cec, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.974725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49096f4-fca8-42fa-addc-98265a980892 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.991270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79072025-21bb-4e4f-a2da-b96edaf3197a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83820ea566f04404a814af603a12a8ba, user_id=5cdb2194a63045cabe6786a014277d89, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.997866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79072025-21bb-4e4f-a2da-b96edaf3197a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.006368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 944/1894] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:30 2022] PUT /identity/v3/projects/b9e8f6f5c0634b42ae983eced9374cbc/users/aa97f5747b414c56ae81db1e72d05cec/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:31.018689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbb56b-cbd6-4ffa-8832-1f7895a3f6e5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.019026 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbb56b-cbd6-4ffa-8832-1f7895a3f6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.019889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbb56b-cbd6-4ffa-8832-1f7895a3f6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.020733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 951/1895] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:30 2022] PUT /identity/v3/projects/83820ea566f04404a814af603a12a8ba/users/5cdb2194a63045cabe6786a014277d89/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:31.042407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de6e7-cfed-43db-8240-a1f99f0fbf07 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.042512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de6e7-cfed-43db-8240-a1f99f0fbf07 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.042762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de6e7-cfed-43db-8240-a1f99f0fbf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.066551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e0cbb56b-cbd6-4ffa-8832-1f7895a3f6e5 None None] MFA Rules not processed for user `aa97f5747b414c56ae81db1e72d05cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:31.068228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e0cbb56b-cbd6-4ffa-8832-1f7895a3f6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:31.139328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a68de6e7-cfed-43db-8240-a1f99f0fbf07 None None] MFA Rules not processed for user `5cdb2194a63045cabe6786a014277d89`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:31.144696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a68de6e7-cfed-43db-8240-a1f99f0fbf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:31.170807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 945/1896] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:31.175324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbb56b-cbd6-4ffa-8832-1f7895a3f6e5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.265004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbb56b-cbd6-4ffa-8832-1f7895a3f6e5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.271206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5f4c-4d39-4008-8d78-0c39ed5b8aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.271947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5f4c-4d39-4008-8d78-0c39ed5b8aca admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.272302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5f4c-4d39-4008-8d78-0c39ed5b8aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.272649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5f4c-4d39-4008-8d78-0c39ed5b8aca admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.273371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a5f4c-4d39-4008-8d78-0c39ed5b8aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.275413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a5f4c-4d39-4008-8d78-0c39ed5b8aca admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.304661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 952/1897] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:31.306764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de6e7-cfed-43db-8240-a1f99f0fbf07 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.309170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a68de6e7-cfed-43db-8240-a1f99f0fbf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:31.334462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 946/1898] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:31 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:31.335452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5f4c-4d39-4008-8d78-0c39ed5b8aca admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.374002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:31.400248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:31.418511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5f4c-4d39-4008-8d78-0c39ed5b8aca admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.430613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc5b4-7559-4708-9608-1229a08aaab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.431273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc5b4-7559-4708-9608-1229a08aaab6 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.431843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc5b4-7559-4708-9608-1229a08aaab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.432188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc5b4-7559-4708-9608-1229a08aaab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.439347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de6e7-cfed-43db-8240-a1f99f0fbf07 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.444157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.445496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.445496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.445496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.447517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:31.578607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.578607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.579709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fc5b4-7559-4708-9608-1229a08aaab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.585301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fc5b4-7559-4708-9608-1229a08aaab6 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.592578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 947/1899] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:31.593317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc5b4-7559-4708-9608-1229a08aaab6 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.615256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 953/1900] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:31.731953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.742806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc5b4-7559-4708-9608-1229a08aaab6 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.744854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2df8-63de-44b3-9e23-4987fdefc26d service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.747967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1b10-824e-45ec-accb-7dddfc1cb5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.749561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1b10-824e-45ec-accb-7dddfc1cb5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.749561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1b10-824e-45ec-accb-7dddfc1cb5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.749800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1b10-824e-45ec-accb-7dddfc1cb5b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.751016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e1b10-824e-45ec-accb-7dddfc1cb5b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.752945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e1b10-824e-45ec-accb-7dddfc1cb5b3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.755915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e219-19ac-4898-aaf4-7a97a20326d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.758291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e219-19ac-4898-aaf4-7a97a20326d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.759030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e219-19ac-4898-aaf4-7a97a20326d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.759030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e219-19ac-4898-aaf4-7a97a20326d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.788336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 948/1901] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:31 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:31.790803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1b10-824e-45ec-accb-7dddfc1cb5b3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.818898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1b10-824e-45ec-accb-7dddfc1cb5b3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.835589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb17f6-e20f-4fec-9bdc-edef4349bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.841354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb17f6-e20f-4fec-9bdc-edef4349bb2e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.842048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb17f6-e20f-4fec-9bdc-edef4349bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.843507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb17f6-e20f-4fec-9bdc-edef4349bb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.848854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb17f6-e20f-4fec-9bdc-edef4349bb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.854694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb17f6-e20f-4fec-9bdc-edef4349bb2e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.902228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 949/1902] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:31.903715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb17f6-e20f-4fec-9bdc-edef4349bb2e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.927198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553e219-19ac-4898-aaf4-7a97a20326d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.929809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553e219-19ac-4898-aaf4-7a97a20326d6 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.938244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb17f6-e20f-4fec-9bdc-edef4349bb2e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.950361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46337c86-da7e-4792-b047-595c16d901a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.952566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337c86-da7e-4792-b047-595c16d901a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.954829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 954/1903] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:31.956202 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337c86-da7e-4792-b047-595c16d901a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.956399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c699ec-de2b-427e-9dd3-d925477f0605 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.956890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c699ec-de2b-427e-9dd3-d925477f0605 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.957483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c699ec-de2b-427e-9dd3-d925477f0605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.957990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337c86-da7e-4792-b047-595c16d901a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.959226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46337c86-da7e-4792-b047-595c16d901a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.962099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46337c86-da7e-4792-b047-595c16d901a7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.002327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 950/1904] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:32.008686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46337c86-da7e-4792-b047-595c16d901a7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.019621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a1c699ec-de2b-427e-9dd3-d925477f0605 None None] MFA Rules not processed for user `df3af1f2ed0b40a9a85441307ac26fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:32.021199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a1c699ec-de2b-427e-9dd3-d925477f0605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:32.038574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46337c86-da7e-4792-b047-595c16d901a7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.058121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59b106-e6e1-49cd-bb0e-88cb0cfb7fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.059349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59b106-e6e1-49cd-bb0e-88cb0cfb7fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.059722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59b106-e6e1-49cd-bb0e-88cb0cfb7fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.060193 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59b106-e6e1-49cd-bb0e-88cb0cfb7fb5 admin admin] PATH_INFO: `/v3/projects/60f5987018eb4405b10625c0d66a736d/users/551d9b53fe0b40da861d2ae60fdbc484/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.101652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59b106-e6e1-49cd-bb0e-88cb0cfb7fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f5987018eb4405b10625c0d66a736d, user_id=551d9b53fe0b40da861d2ae60fdbc484, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.109575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59b106-e6e1-49cd-bb0e-88cb0cfb7fb5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.144108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 951/1905] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:32 2022] PUT /identity/v3/projects/60f5987018eb4405b10625c0d66a736d/users/551d9b53fe0b40da861d2ae60fdbc484/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:32.158687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ae2e-cad8-44ed-a5bb-31b86e5779e8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.162597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ae2e-cad8-44ed-a5bb-31b86e5779e8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.166416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ae2e-cad8-44ed-a5bb-31b86e5779e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.253127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2294ae2e-cad8-44ed-a5bb-31b86e5779e8 None None] MFA Rules not processed for user `551d9b53fe0b40da861d2ae60fdbc484`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:32.255467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2294ae2e-cad8-44ed-a5bb-31b86e5779e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:32.267049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:32.293300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 955/1906] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:32.324385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c699ec-de2b-427e-9dd3-d925477f0605 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.351100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c699ec-de2b-427e-9dd3-d925477f0605 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.374507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:32.382349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 952/1907] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:32.386611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ae2e-cad8-44ed-a5bb-31b86e5779e8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.445201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.451531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.451829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.452115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.461088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:32.478366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ae2e-cad8-44ed-a5bb-31b86e5779e8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.484900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd33003-acd0-4036-9308-46a98a84d3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.485551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd33003-acd0-4036-9308-46a98a84d3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.485834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd33003-acd0-4036-9308-46a98a84d3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.486110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd33003-acd0-4036-9308-46a98a84d3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.486781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd33003-acd0-4036-9308-46a98a84d3d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.488940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd33003-acd0-4036-9308-46a98a84d3d0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.526427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 953/1908] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:32 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:32.528003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd33003-acd0-4036-9308-46a98a84d3d0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.537135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.538692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.548629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 956/1909] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:32.627035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd33003-acd0-4036-9308-46a98a84d3d0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.634736 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e974e-1e3c-45c3-b18b-9565b7e64da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.635375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e974e-1e3c-45c3-b18b-9565b7e64da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.635667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e974e-1e3c-45c3-b18b-9565b7e64da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.635931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e974e-1e3c-45c3-b18b-9565b7e64da7 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.636765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e974e-1e3c-45c3-b18b-9565b7e64da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.639616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e974e-1e3c-45c3-b18b-9565b7e64da7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.670743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 954/1910] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:32 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:32.676732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.688574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b11092-13f5-4b73-ba51-e22d0d18afaa service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.698959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006acdd-1960-499c-8144-4430e946ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.699601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006acdd-1960-499c-8144-4430e946ba51 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.699945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006acdd-1960-499c-8144-4430e946ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.700231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006acdd-1960-499c-8144-4430e946ba51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.701100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006acdd-1960-499c-8144-4430e946ba51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.702815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006acdd-1960-499c-8144-4430e946ba51 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.717827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 957/1911] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:32.735600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e974e-1e3c-45c3-b18b-9565b7e64da7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.747791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e974e-1e3c-45c3-b18b-9565b7e64da7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.753994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78460660-985a-4918-aff1-3e7c83ea737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.755101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78460660-985a-4918-aff1-3e7c83ea737f admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.755399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78460660-985a-4918-aff1-3e7c83ea737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.755683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78460660-985a-4918-aff1-3e7c83ea737f admin admin] PATH_INFO: `/v3/projects/3b974d38b8714793afa2051544610b73/users/9d9f501d077f4dd9955f632ece4d6f15/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.778576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78460660-985a-4918-aff1-3e7c83ea737f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b974d38b8714793afa2051544610b73, user_id=9d9f501d077f4dd9955f632ece4d6f15, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.784518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78460660-985a-4918-aff1-3e7c83ea737f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.797070 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:32.806289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 955/1912] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:32 2022] PUT /identity/v3/projects/3b974d38b8714793afa2051544610b73/users/9d9f501d077f4dd9955f632ece4d6f15/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:32.810703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006acdd-1960-499c-8144-4430e946ba51 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.824354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006acdd-1960-499c-8144-4430e946ba51 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.928904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18436346-fb5f-499d-811a-3206a0ba5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.929614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18436346-fb5f-499d-811a-3206a0ba5552 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.932555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18436346-fb5f-499d-811a-3206a0ba5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.932979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18436346-fb5f-499d-811a-3206a0ba5552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.933782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18436346-fb5f-499d-811a-3206a0ba5552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.935519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18436346-fb5f-499d-811a-3206a0ba5552 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.949507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 958/1913] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:32.955977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78460660-985a-4918-aff1-3e7c83ea737f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.972714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78460660-985a-4918-aff1-3e7c83ea737f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.979152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc333-be40-4b21-9851-c908bb99f65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.980183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc333-be40-4b21-9851-c908bb99f65c admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.980183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc333-be40-4b21-9851-c908bb99f65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.980791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc333-be40-4b21-9851-c908bb99f65c admin admin] PATH_INFO: `/v3/projects/3b974d38b8714793afa2051544610b73/users/9d9f501d077f4dd9955f632ece4d6f15/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.982414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbc333-be40-4b21-9851-c908bb99f65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b974d38b8714793afa2051544610b73, user_id=9d9f501d077f4dd9955f632ece4d6f15, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.985797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbc333-be40-4b21-9851-c908bb99f65c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:33.010122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 956/1914] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:32 2022] PUT /identity/v3/projects/3b974d38b8714793afa2051544610b73/users/9d9f501d077f4dd9955f632ece4d6f15/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:33.012877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9829-061c-46a8-ae5c-546fd3e22ba0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.013283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9829-061c-46a8-ae5c-546fd3e22ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.013745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9829-061c-46a8-ae5c-546fd3e22ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.062464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1cdd9829-061c-46a8-ae5c-546fd3e22ba0 None None] MFA Rules not processed for user `9d9f501d077f4dd9955f632ece4d6f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:33.064038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1cdd9829-061c-46a8-ae5c-546fd3e22ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:33.120228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:33.154958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 959/1915] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:33.167327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc333-be40-4b21-9851-c908bb99f65c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:33.247522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc333-be40-4b21-9851-c908bb99f65c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:33.251324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741c74d-9e76-4c39-b563-0e1a38ca7c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:33.251956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741c74d-9e76-4c39-b563-0e1a38ca7c02 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.252238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741c74d-9e76-4c39-b563-0e1a38ca7c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.252511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741c74d-9e76-4c39-b563-0e1a38ca7c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.263348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741c74d-9e76-4c39-b563-0e1a38ca7c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:33.264800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741c74d-9e76-4c39-b563-0e1a38ca7c02 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:33.276634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 957/1916] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:33.331633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd9829-061c-46a8-ae5c-546fd3e22ba0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:33.346796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd9829-061c-46a8-ae5c-546fd3e22ba0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:33.356568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67683072-202c-4994-9e27-59cc95a58a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:33.357633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67683072-202c-4994-9e27-59cc95a58a9f service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.358146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67683072-202c-4994-9e27-59cc95a58a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.358718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67683072-202c-4994-9e27-59cc95a58a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.476455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67683072-202c-4994-9e27-59cc95a58a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:33.479405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67683072-202c-4994-9e27-59cc95a58a9f service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:33.501645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 960/1917] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:34.114555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741c74d-9e76-4c39-b563-0e1a38ca7c02 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.123859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741c74d-9e76-4c39-b563-0e1a38ca7c02 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.127748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989475-d75c-4326-9a57-0cd2faf5cf7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.128356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989475-d75c-4326-9a57-0cd2faf5cf7b service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.128724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989475-d75c-4326-9a57-0cd2faf5cf7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.128989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989475-d75c-4326-9a57-0cd2faf5cf7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.203504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33989475-d75c-4326-9a57-0cd2faf5cf7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.204978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33989475-d75c-4326-9a57-0cd2faf5cf7b service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.216934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 958/1918] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:36.464636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67683072-202c-4994-9e27-59cc95a58a9f service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:36.481022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67683072-202c-4994-9e27-59cc95a58a9f service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:36.485715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067f4cf-411b-46ef-bf9b-d7cf8663b89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:36.486671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f4cf-411b-46ef-bf9b-d7cf8663b89c service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:36.487020 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f4cf-411b-46ef-bf9b-d7cf8663b89c service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:36.487424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f4cf-411b-46ef-bf9b-d7cf8663b89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:36.490355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4067f4cf-411b-46ef-bf9b-d7cf8663b89c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:36.595454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067f4cf-411b-46ef-bf9b-d7cf8663b89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:36.598507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067f4cf-411b-46ef-bf9b-d7cf8663b89c service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:36.614688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 961/1919] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:37.281721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989475-d75c-4326-9a57-0cd2faf5cf7b service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.401973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989475-d75c-4326-9a57-0cd2faf5cf7b service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.407075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.407751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.408588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.408879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] PATH_INFO: `/v3/users/aa97f5747b414c56ae81db1e72d05cec` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.410645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa97f5747b414c56ae81db1e72d05cec)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.412565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.469433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:37.523537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa97f5747b414c56ae81db1e72d05cec'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.537925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa97f5747b414c56ae81db1e72d05cec'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.538937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa97f5747b414c56ae81db1e72d05cec'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.552688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa97f5747b414c56ae81db1e72d05cec'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.581940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa97f5747b414c56ae81db1e72d05cec'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.597905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 959/1920] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:37 2022] DELETE /identity/v3/users/aa97f5747b414c56ae81db1e72d05cec => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:37.600159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a5873-4fe0-4743-8eb9-5748f0aee3d7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.600851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a5873-4fe0-4743-8eb9-5748f0aee3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.601223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a5873-4fe0-4743-8eb9-5748f0aee3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.637829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0a5a5873-4fe0-4743-8eb9-5748f0aee3d7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:37.639759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0a5a5873-4fe0-4743-8eb9-5748f0aee3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.764397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 962/1921] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:37.776942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.780473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.857022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4664cb3-c114-47bc-9408-07b7c4873c6f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.861158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e4d1-45f7-4df9-af96-045f6fe881f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.861798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e4d1-45f7-4df9-af96-045f6fe881f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.862073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e4d1-45f7-4df9-af96-045f6fe881f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.862388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e4d1-45f7-4df9-af96-045f6fe881f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.873690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1e4d1-45f7-4df9-af96-045f6fe881f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.876445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1e4d1-45f7-4df9-af96-045f6fe881f9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.892918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 960/1922] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:38.378348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a5873-4fe0-4743-8eb9-5748f0aee3d7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.380009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0a5a5873-4fe0-4743-8eb9-5748f0aee3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:38.392819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a5873-4fe0-4743-8eb9-5748f0aee3d7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.398958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.399729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.400073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.400405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] PATH_INFO: `/v3/projects/b9e8f6f5c0634b42ae983eced9374cbc` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.401670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e8f6f5c0634b42ae983eced9374cbc)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.404055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.414183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:38.480146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e8f6f5c0634b42ae983eced9374cbc', 'request_id': 'req-1bf269a3-4b04-4108-b34f-e66200b6e2b3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.490044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e8f6f5c0634b42ae983eced9374cbc', 'request_id': 'req-1bf269a3-4b04-4108-b34f-e66200b6e2b3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.496683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e8f6f5c0634b42ae983eced9374cbc', 'request_id': 'req-1bf269a3-4b04-4108-b34f-e66200b6e2b3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.511376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] The token cache is being invalidate because project b9e8f6f5c0634b42ae983eced9374cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:38.511854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.512561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.514084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 963/1923] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:38 2022] DELETE /identity/v3/projects/b9e8f6f5c0634b42ae983eced9374cbc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:38.518177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e4d1-45f7-4df9-af96-045f6fe881f9 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.529224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e4d1-45f7-4df9-af96-045f6fe881f9 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.620600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.621417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.621810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.622199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] PATH_INFO: `/v3/users/551d9b53fe0b40da861d2ae60fdbc484` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.624760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=551d9b53fe0b40da861d2ae60fdbc484)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.627258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.708632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551d9b53fe0b40da861d2ae60fdbc484'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.710949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:38.741415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551d9b53fe0b40da861d2ae60fdbc484'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.741415 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551d9b53fe0b40da861d2ae60fdbc484'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.763344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551d9b53fe0b40da861d2ae60fdbc484'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.779715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551d9b53fe0b40da861d2ae60fdbc484'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:38.787043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 961/1924] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:38 2022] DELETE /identity/v3/users/551d9b53fe0b40da861d2ae60fdbc484 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:39.289699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.291257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:39.329835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf269a3-4b04-4108-b34f-e66200b6e2b3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.416919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.417996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.418525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.418947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] PATH_INFO: `/v3/projects/60f5987018eb4405b10625c0d66a736d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.420546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f5987018eb4405b10625c0d66a736d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.422807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.497334 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f5987018eb4405b10625c0d66a736d', 'request_id': 'req-7ebfee71-e480-463e-a951-c7d635b37775'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.509150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f5987018eb4405b10625c0d66a736d', 'request_id': 'req-7ebfee71-e480-463e-a951-c7d635b37775'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.516029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f5987018eb4405b10625c0d66a736d', 'request_id': 'req-7ebfee71-e480-463e-a951-c7d635b37775'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.528451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.530001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:39.539827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] The token cache is being invalidate because project 60f5987018eb4405b10625c0d66a736d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:39.540212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.541195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.543227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 964/1925] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:39 2022] DELETE /identity/v3/projects/60f5987018eb4405b10625c0d66a736d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:39.544375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3676de6-b54e-439d-a5eb-5ff8fb67cd3f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.547231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.548986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:39.594518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:39.647905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfee71-e480-463e-a951-c7d635b37775 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.654341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.655100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.655442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.655785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] PATH_INFO: `/v3/users/9d9f501d077f4dd9955f632ece4d6f15` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.657256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9f501d077f4dd9955f632ece4d6f15)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.660558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.696214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.697236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.698018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.698645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] PATH_INFO: `/v3/users/ec61fae235884df881bf03c6a5a73901` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.702384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec61fae235884df881bf03c6a5a73901)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.706814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.742078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9f501d077f4dd9955f632ece4d6f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.752703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9f501d077f4dd9955f632ece4d6f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.758417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9f501d077f4dd9955f632ece4d6f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.768232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9f501d077f4dd9955f632ece4d6f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.769988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-74a93a1e-ac79-4940-9345-6691341d75c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9f501d077f4dd9955f632ece4d6f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.802179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 965/1926] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:39 2022] DELETE /identity/v3/users/9d9f501d077f4dd9955f632ece4d6f15 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:39.811271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec61fae235884df881bf03c6a5a73901'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.826939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec61fae235884df881bf03c6a5a73901'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.828499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec61fae235884df881bf03c6a5a73901'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.847991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec61fae235884df881bf03c6a5a73901'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.887284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec61fae235884df881bf03c6a5a73901'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:39.902586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 962/1927] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:39 2022] DELETE /identity/v3/users/ec61fae235884df881bf03c6a5a73901 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:39.910606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b0c8-9311-4803-9247-1b12edae90e9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.910606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b0c8-9311-4803-9247-1b12edae90e9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.910606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b0c8-9311-4803-9247-1b12edae90e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.957906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0d14b0c8-9311-4803-9247-1b12edae90e9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:39.959612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d14b0c8-9311-4803-9247-1b12edae90e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:40.073893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 966/1928] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:40.092799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.104383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:40.242124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:40.268098 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7486-ac5a-44d5-bc29-4be953131188 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:40.281938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef96a-955a-419a-99ea-59e412226396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:40.282711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef96a-955a-419a-99ea-59e412226396 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.283124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef96a-955a-419a-99ea-59e412226396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.283414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef96a-955a-419a-99ea-59e412226396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.297607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef96a-955a-419a-99ea-59e412226396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:40.299585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef96a-955a-419a-99ea-59e412226396 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:40.324059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14b0c8-9311-4803-9247-1b12edae90e9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.327929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d14b0c8-9311-4803-9247-1b12edae90e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:40.333656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 963/1929] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:40.386629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14b0c8-9311-4803-9247-1b12edae90e9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:40.402731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:40.403737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.404228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.404699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] PATH_INFO: `/v3/projects/3b974d38b8714793afa2051544610b73` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.406875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b974d38b8714793afa2051544610b73)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:40.412940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:40.510392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:40.541949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b974d38b8714793afa2051544610b73', 'request_id': 'req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.543770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b974d38b8714793afa2051544610b73', 'request_id': 'req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.556109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b974d38b8714793afa2051544610b73', 'request_id': 'req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.579885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] The token cache is being invalidate because project 3b974d38b8714793afa2051544610b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:40.580437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.581781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cf63f6ce-83fe-4208-a06d-d3827bd5a2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.584684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 967/1930] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:40 2022] DELETE /identity/v3/projects/3b974d38b8714793afa2051544610b73 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:40.593418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8c64-621a-4ce6-b58d-bb7c7ab3f054 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.594200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8c64-621a-4ce6-b58d-bb7c7ab3f054 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.594200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8c64-621a-4ce6-b58d-bb7c7ab3f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.617594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b57d8c64-621a-4ce6-b58d-bb7c7ab3f054 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:40.618959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b57d8c64-621a-4ce6-b58d-bb7c7ab3f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:40.746997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 964/1931] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:40.757415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a39770-ee9f-4bc2-84fe-ffdb656b7f05 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.757888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a39770-ee9f-4bc2-84fe-ffdb656b7f05 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.758469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a39770-ee9f-4bc2-84fe-ffdb656b7f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.783897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-04a39770-ee9f-4bc2-84fe-ffdb656b7f05 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:40.785195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-04a39770-ee9f-4bc2-84fe-ffdb656b7f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:40.795978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 968/1932] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:40.801613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d8c64-621a-4ce6-b58d-bb7c7ab3f054 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.813658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d8c64-621a-4ce6-b58d-bb7c7ab3f054 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:40.820053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:40.820787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.821042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.821457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.822436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:40.822857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:40.824936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:40.834330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a39770-ee9f-4bc2-84fe-ffdb656b7f05 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.836338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-04a39770-ee9f-4bc2-84fe-ffdb656b7f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:40.843481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 965/1933] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:40.848934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.855570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a39770-ee9f-4bc2-84fe-ffdb656b7f05 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:40.863439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:40.864699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.865198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.865698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] PATH_INFO: `/v3/projects/136b69e3b14b47799003caecde8f88e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.865959 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811d6a3-34a4-4867-afd4-5d524db67284 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:40.867773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=136b69e3b14b47799003caecde8f88e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:40.870722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:40.872972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd626b-16b6-430d-95b3-4ac94fececaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:40.875161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd626b-16b6-430d-95b3-4ac94fececaf admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.875527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd626b-16b6-430d-95b3-4ac94fececaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.875869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd626b-16b6-430d-95b3-4ac94fececaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.877150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd626b-16b6-430d-95b3-4ac94fececaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:40.880231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd626b-16b6-430d-95b3-4ac94fececaf admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:40.934628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 966/1934] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:40 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:40.941606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd626b-16b6-430d-95b3-4ac94fececaf admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.945072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136b69e3b14b47799003caecde8f88e5', 'request_id': 'req-5720738a-de79-495f-b2e0-942ac8f5d55d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.953082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136b69e3b14b47799003caecde8f88e5', 'request_id': 'req-5720738a-de79-495f-b2e0-942ac8f5d55d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.960667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136b69e3b14b47799003caecde8f88e5', 'request_id': 'req-5720738a-de79-495f-b2e0-942ac8f5d55d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.979036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] The token cache is being invalidate because project 136b69e3b14b47799003caecde8f88e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:40.979369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.980580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.982288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 969/1935] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:40 2022] DELETE /identity/v3/projects/136b69e3b14b47799003caecde8f88e5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:40.989406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.995911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:41.023976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd626b-16b6-430d-95b3-4ac94fececaf admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.032335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.033131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.033467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.033747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.036093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.038781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.063417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 967/1936] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:40 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:41.068222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.071036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:41.074190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720738a-de79-495f-b2e0-942ac8f5d55d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.079476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.080127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.080407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.080683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] PATH_INFO: `/v3/users/055e5fd7b94541da83fe2a019c84464b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.082046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] RBAC: Authorizing `identity:delete_user(user_id=055e5fd7b94541da83fe2a019c84464b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.083929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.085978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f94589-8d2f-4fff-998d-9d15137dd10d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.091130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5231-0abf-4008-a335-4eed29e3f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.091759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5231-0abf-4008-a335-4eed29e3f5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.092036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5231-0abf-4008-a335-4eed29e3f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.092313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5231-0abf-4008-a335-4eed29e3f5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.092978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b5231-0abf-4008-a335-4eed29e3f5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.094691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b5231-0abf-4008-a335-4eed29e3f5f7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.108149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 968/1937] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:41.115206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5231-0abf-4008-a335-4eed29e3f5f7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.129765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5231-0abf-4008-a335-4eed29e3f5f7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.135314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc33f-55a9-47f0-893c-50a63a10f6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.135943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc33f-55a9-47f0-893c-50a63a10f6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.136226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc33f-55a9-47f0-893c-50a63a10f6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.136499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc33f-55a9-47f0-893c-50a63a10f6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.137155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cc33f-55a9-47f0-893c-50a63a10f6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.138849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cc33f-55a9-47f0-893c-50a63a10f6f9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.148821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055e5fd7b94541da83fe2a019c84464b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.150461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:41.154321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 969/1938] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:41.156658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc33f-55a9-47f0-893c-50a63a10f6f9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.163110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055e5fd7b94541da83fe2a019c84464b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.164508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055e5fd7b94541da83fe2a019c84464b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.169566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc33f-55a9-47f0-893c-50a63a10f6f9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.173647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055e5fd7b94541da83fe2a019c84464b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.174547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5dcaf4e7-4756-405f-b570-ff95b0a1348a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055e5fd7b94541da83fe2a019c84464b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.178167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.179285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.179757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.180221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] PATH_INFO: `/v3/projects/e607942ded474f848853df6a6cb7af6b/users/ace8f58b44df4e429b953813829b0bc1/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.198349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 970/1939] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:40 2022] DELETE /identity/v3/users/055e5fd7b94541da83fe2a019c84464b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:41.206470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e607942ded474f848853df6a6cb7af6b, user_id=ace8f58b44df4e429b953813829b0bc1, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.213214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.219008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:41.240580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 970/1940] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:41 2022] PUT /identity/v3/projects/e607942ded474f848853df6a6cb7af6b/users/ace8f58b44df4e429b953813829b0bc1/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:41.263007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9361d-8734-40a3-ad03-809b608faaa9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.263308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9361d-8734-40a3-ad03-809b608faaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.263564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9361d-8734-40a3-ad03-809b608faaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.298907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-aca9361d-8734-40a3-ad03-809b608faaa9 None None] MFA Rules not processed for user `ace8f58b44df4e429b953813829b0bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:41.300827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aca9361d-8734-40a3-ad03-809b608faaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:41.416371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 971/1941] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:41.422080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.425288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:41.558396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499888-9ab2-4bcc-95a4-e669ad49ca19 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.571536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.572852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.573357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.573973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.575283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.579135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.644336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9361d-8734-40a3-ad03-809b608faaa9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.651740 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 971/1942] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:41 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:41.665152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9361d-8734-40a3-ad03-809b608faaa9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.689188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.693023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:41.787089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0e8b-ad5f-49c9-944c-d40f2e3019a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.788970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0e8b-ad5f-49c9-944c-d40f2e3019a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.789303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0e8b-ad5f-49c9-944c-d40f2e3019a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.789588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0e8b-ad5f-49c9-944c-d40f2e3019a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.790647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0e8b-ad5f-49c9-944c-d40f2e3019a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.793386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0e8b-ad5f-49c9-944c-d40f2e3019a4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.830741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 972/1943] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:41 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:41.836382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0e8b-ad5f-49c9-944c-d40f2e3019a4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.861721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0e8b-ad5f-49c9-944c-d40f2e3019a4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.882749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f053f-048e-428b-b219-7546c68f8cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.882749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f053f-048e-428b-b219-7546c68f8cef admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.882749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f053f-048e-428b-b219-7546c68f8cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.882749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f053f-048e-428b-b219-7546c68f8cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.883373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f053f-048e-428b-b219-7546c68f8cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.883373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f053f-048e-428b-b219-7546c68f8cef admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.896700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 973/1944] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:41.897899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f053f-048e-428b-b219-7546c68f8cef admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.909551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f053f-048e-428b-b219-7546c68f8cef admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.915939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be940d6-8ace-44fc-b8dd-a85c8e626b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.916947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be940d6-8ace-44fc-b8dd-a85c8e626b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.917602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be940d6-8ace-44fc-b8dd-a85c8e626b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.917841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be940d6-8ace-44fc-b8dd-a85c8e626b39 admin admin] PATH_INFO: `/v3/projects/529a43cbb4144cb4b4f53263881f258e/users/1f33ad48e0dc4eb6993fa761987258c3/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.920203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77a79-5ef1-4e63-8f25-efbb632139e8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.939045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be940d6-8ace-44fc-b8dd-a85c8e626b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529a43cbb4144cb4b4f53263881f258e, user_id=1f33ad48e0dc4eb6993fa761987258c3, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.943553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be940d6-8ace-44fc-b8dd-a85c8e626b39 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.950308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.950308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.950308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.950308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] PATH_INFO: `/v3/projects/f6e340b7fdf54577b850868b386e4da9` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.951289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e340b7fdf54577b850868b386e4da9)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.953405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.965368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 974/1945] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:41 2022] PUT /identity/v3/projects/529a43cbb4144cb4b4f53263881f258e/users/1f33ad48e0dc4eb6993fa761987258c3/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:41.969871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be940d6-8ace-44fc-b8dd-a85c8e626b39 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.987301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:42.095599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e340b7fdf54577b850868b386e4da9', 'request_id': 'req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.108561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e340b7fdf54577b850868b386e4da9', 'request_id': 'req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.124765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e340b7fdf54577b850868b386e4da9', 'request_id': 'req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.138615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be940d6-8ace-44fc-b8dd-a85c8e626b39 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.138890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] The token cache is being invalidate because project f6e340b7fdf54577b850868b386e4da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:42.139202 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.140078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.142050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 972/1946] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:41 2022] DELETE /identity/v3/projects/f6e340b7fdf54577b850868b386e4da9 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:42.146916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.148565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.165310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:42.227862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.228728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.229068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.229398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.230523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.233041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.256783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 975/1947] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:42.258721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f9cf-aecb-4037-bdb0-a9f082ee42e8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.263241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.265844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.267840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.269074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.269581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.270080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] PATH_INFO: `/v3/users/c2c2cf2914a64a3fa2e88b23fcdde8ee` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.272544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c2cf2914a64a3fa2e88b23fcdde8ee)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.277054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.283354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de43a0-1ee9-41f0-a72f-83d5f8309479 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.289734 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45afdf5-9b28-4018-86c3-de22f3add59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.290449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45afdf5-9b28-4018-86c3-de22f3add59b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.290733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45afdf5-9b28-4018-86c3-de22f3add59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.291007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45afdf5-9b28-4018-86c3-de22f3add59b admin admin] PATH_INFO: `/v3/projects/529a43cbb4144cb4b4f53263881f258e/users/1f33ad48e0dc4eb6993fa761987258c3/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.293122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45afdf5-9b28-4018-86c3-de22f3add59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=529a43cbb4144cb4b4f53263881f258e, user_id=1f33ad48e0dc4eb6993fa761987258c3, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.296267 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45afdf5-9b28-4018-86c3-de22f3add59b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.309523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 976/1948] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:42 2022] PUT /identity/v3/projects/529a43cbb4144cb4b4f53263881f258e/users/1f33ad48e0dc4eb6993fa761987258c3/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:42.320849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb269f-34ad-43c2-a675-812ed4e57d56 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.321061 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb269f-34ad-43c2-a675-812ed4e57d56 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.321326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb269f-34ad-43c2-a675-812ed4e57d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.362406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-feeb269f-34ad-43c2-a675-812ed4e57d56 None None] MFA Rules not processed for user `1f33ad48e0dc4eb6993fa761987258c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:42.365001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-feeb269f-34ad-43c2-a675-812ed4e57d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.380254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c2cf2914a64a3fa2e88b23fcdde8ee'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.392333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c2cf2914a64a3fa2e88b23fcdde8ee'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.393404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c2cf2914a64a3fa2e88b23fcdde8ee'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.411503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c2cf2914a64a3fa2e88b23fcdde8ee'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.473483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c2cf2914a64a3fa2e88b23fcdde8ee'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.478313 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 977/1949] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:42.493008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 973/1950] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:42 2022] DELETE /identity/v3/users/c2c2cf2914a64a3fa2e88b23fcdde8ee => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:42.506617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb269f-34ad-43c2-a675-812ed4e57d56 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.511558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-feeb269f-34ad-43c2-a675-812ed4e57d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.541543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:42.578406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb269f-34ad-43c2-a675-812ed4e57d56 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.637072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0858-bb65-4043-9c7a-22a380a8ed1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.637712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0858-bb65-4043-9c7a-22a380a8ed1a service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.637984 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0858-bb65-4043-9c7a-22a380a8ed1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.638281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0858-bb65-4043-9c7a-22a380a8ed1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.640182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b3fd0858-bb65-4043-9c7a-22a380a8ed1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.748401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd0858-bb65-4043-9c7a-22a380a8ed1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.750133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd0858-bb65-4043-9c7a-22a380a8ed1a service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.761092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 978/1951] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:42.950004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.952862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.102603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3096e-8d07-4916-a10c-fa2eaa5aa406 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.122326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.123413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.123701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.124154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] PATH_INFO: `/v3/projects/fcc85b3c767c40e8abba31da8d9ca9b7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.127373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc85b3c767c40e8abba31da8d9ca9b7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.132986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.199373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:43.230583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc85b3c767c40e8abba31da8d9ca9b7', 'request_id': 'req-58a4f70e-c6d5-4527-8228-64da2f0661e4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.243778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc85b3c767c40e8abba31da8d9ca9b7', 'request_id': 'req-58a4f70e-c6d5-4527-8228-64da2f0661e4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.275789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc85b3c767c40e8abba31da8d9ca9b7', 'request_id': 'req-58a4f70e-c6d5-4527-8228-64da2f0661e4'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.301747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] The token cache is being invalidate because project fcc85b3c767c40e8abba31da8d9ca9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:43.302252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.303052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-58a4f70e-c6d5-4527-8228-64da2f0661e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.306374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 974/1952] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:42 2022] DELETE /identity/v3/projects/fcc85b3c767c40e8abba31da8d9ca9b7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:43.316865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb43568-22b0-4c5c-ba54-0ce0bb57ed52 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.317640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb43568-22b0-4c5c-ba54-0ce0bb57ed52 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.318026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb43568-22b0-4c5c-ba54-0ce0bb57ed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.379949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bdb43568-22b0-4c5c-ba54-0ce0bb57ed52 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:43.381197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bdb43568-22b0-4c5c-ba54-0ce0bb57ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.511790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 979/1953] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:43.516203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b193e-cb9f-49c0-8bc7-7cd73e987735 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.516641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b193e-cb9f-49c0-8bc7-7cd73e987735 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.516988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b193e-cb9f-49c0-8bc7-7cd73e987735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.573270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c03b193e-cb9f-49c0-8bc7-7cd73e987735 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:43.575948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c03b193e-cb9f-49c0-8bc7-7cd73e987735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.586302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 975/1954] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:43.599897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb43568-22b0-4c5c-ba54-0ce0bb57ed52 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.613634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb43568-22b0-4c5c-ba54-0ce0bb57ed52 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.629945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.630617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.630899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.631168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.632015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:43.632324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.634090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.664674 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 980/1955] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:43.670318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b193e-cb9f-49c0-8bc7-7cd73e987735 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.688844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b193e-cb9f-49c0-8bc7-7cd73e987735 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.701624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c06a-8ea9-429d-b631-3ea0c34b735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.702484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c06a-8ea9-429d-b631-3ea0c34b735d admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.703767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c06a-8ea9-429d-b631-3ea0c34b735d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.704264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c06a-8ea9-429d-b631-3ea0c34b735d admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.705088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4c06a-8ea9-429d-b631-3ea0c34b735d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.708304 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4c06a-8ea9-429d-b631-3ea0c34b735d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.753782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 976/1956] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:43 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:43.760142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.772746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5e6c-3f83-4e51-9584-8efd0f923857 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.805696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:43.870653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c56ac-f0c9-4535-84db-2af37b69369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.871732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c56ac-f0c9-4535-84db-2af37b69369e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.872240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c56ac-f0c9-4535-84db-2af37b69369e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.872749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c56ac-f0c9-4535-84db-2af37b69369e admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.873953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c56ac-f0c9-4535-84db-2af37b69369e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.877821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c56ac-f0c9-4535-84db-2af37b69369e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.912435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 981/1957] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:43 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:43.917384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c06a-8ea9-429d-b631-3ea0c34b735d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.928691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c06a-8ea9-429d-b631-3ea0c34b735d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.933332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afac59-1d71-4b82-b9ee-fa477109a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.934036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afac59-1d71-4b82-b9ee-fa477109a1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.934290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afac59-1d71-4b82-b9ee-fa477109a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.934543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afac59-1d71-4b82-b9ee-fa477109a1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.935186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afac59-1d71-4b82-b9ee-fa477109a1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.936804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afac59-1d71-4b82-b9ee-fa477109a1ee admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.948508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 977/1958] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:43.952951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c56ac-f0c9-4535-84db-2af37b69369e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.963020 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c56ac-f0c9-4535-84db-2af37b69369e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.967795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ac199-b699-424a-bfe1-b51b430eb92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.968407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac199-b699-424a-bfe1-b51b430eb92d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.968691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac199-b699-424a-bfe1-b51b430eb92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.968973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac199-b699-424a-bfe1-b51b430eb92d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.969626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ac199-b699-424a-bfe1-b51b430eb92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.971278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ac199-b699-424a-bfe1-b51b430eb92d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.987307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 982/1959] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:43.989679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afac59-1d71-4b82-b9ee-fa477109a1ee admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.000778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afac59-1d71-4b82-b9ee-fa477109a1ee admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.009860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65939145-8396-46bf-8fe5-ec5a9963a543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.011481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939145-8396-46bf-8fe5-ec5a9963a543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.011481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939145-8396-46bf-8fe5-ec5a9963a543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.011481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65939145-8396-46bf-8fe5-ec5a9963a543 admin admin] PATH_INFO: `/v3/projects/ffd258c0ec014655b981230e523f0039/users/0977a684c2564c3087af0266b7fe6386/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.028907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65939145-8396-46bf-8fe5-ec5a9963a543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd258c0ec014655b981230e523f0039, user_id=0977a684c2564c3087af0266b7fe6386, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.031700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65939145-8396-46bf-8fe5-ec5a9963a543 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.054503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 978/1960] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:43 2022] PUT /identity/v3/projects/ffd258c0ec014655b981230e523f0039/users/0977a684c2564c3087af0266b7fe6386/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:44.068266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31871a5-3cac-44b7-8c73-d7dae5d40d7e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.068699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31871a5-3cac-44b7-8c73-d7dae5d40d7e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.069070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31871a5-3cac-44b7-8c73-d7dae5d40d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.103127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c31871a5-3cac-44b7-8c73-d7dae5d40d7e None None] MFA Rules not processed for user `0977a684c2564c3087af0266b7fe6386`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:44.104401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c31871a5-3cac-44b7-8c73-d7dae5d40d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:44.185559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 983/1961] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:44.190819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65939145-8396-46bf-8fe5-ec5a9963a543 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.266404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65939145-8396-46bf-8fe5-ec5a9963a543 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.272488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75d6b-a585-42d6-8a8a-4cbe02756f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.273258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75d6b-a585-42d6-8a8a-4cbe02756f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.273544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75d6b-a585-42d6-8a8a-4cbe02756f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.273820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75d6b-a585-42d6-8a8a-4cbe02756f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.274809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b75d6b-a585-42d6-8a8a-4cbe02756f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.277381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b75d6b-a585-42d6-8a8a-4cbe02756f54 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.315745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 979/1962] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:44 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:44.321730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31871a5-3cac-44b7-8c73-d7dae5d40d7e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.335269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31871a5-3cac-44b7-8c73-d7dae5d40d7e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.410386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf12d93-ab49-48b7-a3ab-13fbace4a0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.411209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12d93-ab49-48b7-a3ab-13fbace4a0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.411678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12d93-ab49-48b7-a3ab-13fbace4a0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.411964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf12d93-ab49-48b7-a3ab-13fbace4a0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.412627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf12d93-ab49-48b7-a3ab-13fbace4a0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.414622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf12d93-ab49-48b7-a3ab-13fbace4a0f5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.449775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 984/1963] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:44 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:44.451065 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75d6b-a585-42d6-8a8a-4cbe02756f54 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.463619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75d6b-a585-42d6-8a8a-4cbe02756f54 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.477242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873d1d-7b1e-44d9-941c-5a7778040e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.477873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873d1d-7b1e-44d9-941c-5a7778040e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.478165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873d1d-7b1e-44d9-941c-5a7778040e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.478485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873d1d-7b1e-44d9-941c-5a7778040e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.479144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82873d1d-7b1e-44d9-941c-5a7778040e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.480776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82873d1d-7b1e-44d9-941c-5a7778040e65 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.494307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 980/1964] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:44.501259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf12d93-ab49-48b7-a3ab-13fbace4a0f5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.517983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf12d93-ab49-48b7-a3ab-13fbace4a0f5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.523486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd606-21a7-41ed-8376-0ff31faa6fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.524588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd606-21a7-41ed-8376-0ff31faa6fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.524890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd606-21a7-41ed-8376-0ff31faa6fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.525176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefd606-21a7-41ed-8376-0ff31faa6fc8 admin admin] PATH_INFO: `/v3/projects/98315899df8447b384ed85541886bb17/users/5fd4e187db9d4083af73e2c86fdeeb39/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.545529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefd606-21a7-41ed-8376-0ff31faa6fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98315899df8447b384ed85541886bb17, user_id=5fd4e187db9d4083af73e2c86fdeeb39, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.548321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefd606-21a7-41ed-8376-0ff31faa6fc8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.552781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:44.579495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 985/1965] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:44 2022] PUT /identity/v3/projects/98315899df8447b384ed85541886bb17/users/5fd4e187db9d4083af73e2c86fdeeb39/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:44.583986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873d1d-7b1e-44d9-941c-5a7778040e65 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.594933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873d1d-7b1e-44d9-941c-5a7778040e65 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.635269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:44.688059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba0657-329f-4c62-9ae3-4664ef5a4e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.689033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0657-329f-4c62-9ae3-4664ef5a4e8f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.689573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0657-329f-4c62-9ae3-4664ef5a4e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.689699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0657-329f-4c62-9ae3-4664ef5a4e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.690456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba0657-329f-4c62-9ae3-4664ef5a4e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.692815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba0657-329f-4c62-9ae3-4664ef5a4e8f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.704649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 981/1966] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:44.710342 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd606-21a7-41ed-8376-0ff31faa6fc8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.723569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefd606-21a7-41ed-8376-0ff31faa6fc8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.728996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.729666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.729941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.730217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] PATH_INFO: `/v3/projects/98315899df8447b384ed85541886bb17/users/5fd4e187db9d4083af73e2c86fdeeb39/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.732207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=98315899df8447b384ed85541886bb17, user_id=5fd4e187db9d4083af73e2c86fdeeb39, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.735633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.749251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 986/1967] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:44 2022] PUT /identity/v3/projects/98315899df8447b384ed85541886bb17/users/5fd4e187db9d4083af73e2c86fdeeb39/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:44.761815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f777f-1e21-4786-b15c-f7c5f2453445 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.762391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f777f-1e21-4786-b15c-f7c5f2453445 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.762903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f777f-1e21-4786-b15c-f7c5f2453445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.831361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-be1f777f-1e21-4786-b15c-f7c5f2453445 None None] MFA Rules not processed for user `5fd4e187db9d4083af73e2c86fdeeb39`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:44.833980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-be1f777f-1e21-4786-b15c-f7c5f2453445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:44.968155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 982/1968] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:45.032153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.033890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:45.121602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b4b87-df4f-430d-8223-6f33af8fa4ec admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.131346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb08be2-383e-4fcb-a5ce-a85c38151fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.134467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08be2-383e-4fcb-a5ce-a85c38151fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.134467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08be2-383e-4fcb-a5ce-a85c38151fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.134755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08be2-383e-4fcb-a5ce-a85c38151fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.158514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb08be2-383e-4fcb-a5ce-a85c38151fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.162742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb08be2-383e-4fcb-a5ce-a85c38151fd3 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.181683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 987/1969] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:45.258404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f777f-1e21-4786-b15c-f7c5f2453445 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.260485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-be1f777f-1e21-4786-b15c-f7c5f2453445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:45.281724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f777f-1e21-4786-b15c-f7c5f2453445 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.288077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7d2fa-7303-4113-bde6-90c890c7e59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.288758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d2fa-7303-4113-bde6-90c890c7e59a service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.289053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d2fa-7303-4113-bde6-90c890c7e59a service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.289308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d2fa-7303-4113-bde6-90c890c7e59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.357537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7d2fa-7303-4113-bde6-90c890c7e59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.359038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7d2fa-7303-4113-bde6-90c890c7e59a service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.368690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 983/1970] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:47.436106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb08be2-383e-4fcb-a5ce-a85c38151fd3 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:47.450094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb08be2-383e-4fcb-a5ce-a85c38151fd3 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:47.454528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd58554-51e5-4765-809b-b5952d586dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:47.455080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd58554-51e5-4765-809b-b5952d586dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:47.455336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd58554-51e5-4765-809b-b5952d586dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:47.455591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd58554-51e5-4765-809b-b5952d586dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:47.458021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6fd58554-51e5-4765-809b-b5952d586dc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:47.538529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd58554-51e5-4765-809b-b5952d586dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:47.540086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd58554-51e5-4765-809b-b5952d586dc0 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:47.553448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 988/1971] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:49.188106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7d2fa-7303-4113-bde6-90c890c7e59a service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:49.276584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:49.298999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7d2fa-7303-4113-bde6-90c890c7e59a service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:49.309519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:49.310369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:49.310731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:49.311063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] PATH_INFO: `/v3/users/0977a684c2564c3087af0266b7fe6386` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:49.312517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0977a684c2564c3087af0266b7fe6386)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:49.314598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:49.403305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0977a684c2564c3087af0266b7fe6386'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.419167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0977a684c2564c3087af0266b7fe6386'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.419937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0977a684c2564c3087af0266b7fe6386'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.433225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0977a684c2564c3087af0266b7fe6386'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.478139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0977a684c2564c3087af0266b7fe6386'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.489906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 984/1972] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:49 2022] DELETE /identity/v3/users/0977a684c2564c3087af0266b7fe6386 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:49.494405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7854-871e-4647-b9d2-c39af0b0d7e5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:49.495262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7854-871e-4647-b9d2-c39af0b0d7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:49.495262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd7854-871e-4647-b9d2-c39af0b0d7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:49.521711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-69dd7854-871e-4647-b9d2-c39af0b0d7e5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:49.523339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-69dd7854-871e-4647-b9d2-c39af0b0d7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:49.664103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 989/1973] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:49.682880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:49.691495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:49.857541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468fc2-30af-4d0b-96f5-9fdc6f60319d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:49.869636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851e512-45ad-4c08-a643-d6939ed635cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:49.872430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851e512-45ad-4c08-a643-d6939ed635cf service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:49.873173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851e512-45ad-4c08-a643-d6939ed635cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:49.873877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851e512-45ad-4c08-a643-d6939ed635cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:49.919756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851e512-45ad-4c08-a643-d6939ed635cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:49.922023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851e512-45ad-4c08-a643-d6939ed635cf service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:49.934323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 985/1974] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:49.935008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd7854-871e-4647-b9d2-c39af0b0d7e5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:49.942913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-69dd7854-871e-4647-b9d2-c39af0b0d7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:49.959602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd7854-871e-4647-b9d2-c39af0b0d7e5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:49.965249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:49.965887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:49.966174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:49.966622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] PATH_INFO: `/v3/users/be1db1c8d12a402ab74df1e387705e7e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:49.968124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1db1c8d12a402ab74df1e387705e7e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:49.970144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:49.988902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:50.046837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1db1c8d12a402ab74df1e387705e7e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.064806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1db1c8d12a402ab74df1e387705e7e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.066953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1db1c8d12a402ab74df1e387705e7e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.080111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1db1c8d12a402ab74df1e387705e7e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.083039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1db1c8d12a402ab74df1e387705e7e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.117965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 990/1975] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:49 2022] DELETE /identity/v3/users/be1db1c8d12a402ab74df1e387705e7e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:50.124965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390f68e-bc67-48a9-bbd5-f6fba1877a5c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:50.125404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390f68e-bc67-48a9-bbd5-f6fba1877a5c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:50.126483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390f68e-bc67-48a9-bbd5-f6fba1877a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:50.153923 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0390f68e-bc67-48a9-bbd5-f6fba1877a5c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:50.156212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0390f68e-bc67-48a9-bbd5-f6fba1877a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:50.236462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 986/1976] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:50.249740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:50.251966 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:50.290166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390f68e-bc67-48a9-bbd5-f6fba1877a5c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:50.292039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0390f68e-bc67-48a9-bbd5-f6fba1877a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:50.311801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390f68e-bc67-48a9-bbd5-f6fba1877a5c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:50.322045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:50.323487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:50.324419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:50.325376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] PATH_INFO: `/v3/users/4fac14b657fb49df957ff5fbf5d24cc6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:50.339147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fac14b657fb49df957ff5fbf5d24cc6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:50.341326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:50.351575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:50.384387 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7889368-cf1b-4f50-8324-a28057ff9313 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:50.391294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:50.392113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:50.392436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:50.392905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:50.406936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:50.408908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:50.423372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 991/1977] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:50.447458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fac14b657fb49df957ff5fbf5d24cc6'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.462940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fac14b657fb49df957ff5fbf5d24cc6'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.464171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fac14b657fb49df957ff5fbf5d24cc6'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.484451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fac14b657fb49df957ff5fbf5d24cc6'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.511124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fac14b657fb49df957ff5fbf5d24cc6'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.520894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 987/1978] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:50 2022] DELETE /identity/v3/users/4fac14b657fb49df957ff5fbf5d24cc6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:50.714941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:50.717872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:50.741858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443c501-d521-4c15-bb9e-2919027707d7 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:50.785590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:50.789219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:50.921281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:50.921973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:50.922273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:50.922378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70fb8f-47da-43b1-bc1a-4558fb8c7273 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:50.922568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] PATH_INFO: `/v3/projects/ffd258c0ec014655b981230e523f0039` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:50.924025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd258c0ec014655b981230e523f0039)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:50.927543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:50.930993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:50.932123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:50.932589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:50.933023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] PATH_INFO: `/v3/projects/bb057c74fa2c4a3cb5be2bff358f37b4` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:50.934809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb057c74fa2c4a3cb5be2bff358f37b4)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:50.937650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:50.987743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:51.002161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd258c0ec014655b981230e523f0039', 'request_id': 'req-bd348f94-68f1-4513-a376-e47ada9ac4cb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.015156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd258c0ec014655b981230e523f0039', 'request_id': 'req-bd348f94-68f1-4513-a376-e47ada9ac4cb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.034853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd258c0ec014655b981230e523f0039', 'request_id': 'req-bd348f94-68f1-4513-a376-e47ada9ac4cb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.059711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] The token cache is being invalidate because project ffd258c0ec014655b981230e523f0039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:51.060132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.062503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.070313 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 992/1979] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:50 2022] DELETE /identity/v3/projects/ffd258c0ec014655b981230e523f0039 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:51.074370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:51.077054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:51.102482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb057c74fa2c4a3cb5be2bff358f37b4', 'request_id': 'req-45c322dd-53fc-4f14-be14-8d0cae8e277e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.140810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb057c74fa2c4a3cb5be2bff358f37b4', 'request_id': 'req-45c322dd-53fc-4f14-be14-8d0cae8e277e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.150466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb057c74fa2c4a3cb5be2bff358f37b4', 'request_id': 'req-45c322dd-53fc-4f14-be14-8d0cae8e277e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.168813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] The token cache is being invalidate because project bb057c74fa2c4a3cb5be2bff358f37b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:51.169772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.170687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.175204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 988/1980] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:50 2022] DELETE /identity/v3/projects/bb057c74fa2c4a3cb5be2bff358f37b4 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:51.176776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:51.178208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:51.202989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:51.218177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348f94-68f1-4513-a376-e47ada9ac4cb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:51.305606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:51.306410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:51.306793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:51.307204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] PATH_INFO: `/v3/users/5fd4e187db9d4083af73e2c86fdeeb39` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:51.308591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd4e187db9d4083af73e2c86fdeeb39)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:51.311362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:51.346287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c322dd-53fc-4f14-be14-8d0cae8e277e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:51.346287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:51.346287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:51.346287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:51.347383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] PATH_INFO: `/v3/projects/b5a5170f0907491ebda6ed5f30ef9de2` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:51.347383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a5170f0907491ebda6ed5f30ef9de2)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:51.350623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:51.390107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd4e187db9d4083af73e2c86fdeeb39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.398898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd4e187db9d4083af73e2c86fdeeb39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.399682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd4e187db9d4083af73e2c86fdeeb39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.411577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd4e187db9d4083af73e2c86fdeeb39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.412629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd4e187db9d4083af73e2c86fdeeb39'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.416082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a5170f0907491ebda6ed5f30ef9de2', 'request_id': 'req-8157eb87-be33-46ac-9223-7fa8c64371c6'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.422783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a5170f0907491ebda6ed5f30ef9de2', 'request_id': 'req-8157eb87-be33-46ac-9223-7fa8c64371c6'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.427385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:51.434211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a5170f0907491ebda6ed5f30ef9de2', 'request_id': 'req-8157eb87-be33-46ac-9223-7fa8c64371c6'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.441270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 993/1981] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:51 2022] DELETE /identity/v3/users/5fd4e187db9d4083af73e2c86fdeeb39 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:51.442346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:51.447335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:51.458998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] The token cache is being invalidate because project b5a5170f0907491ebda6ed5f30ef9de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:51.459223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.459947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.461928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 989/1982] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:51 2022] DELETE /identity/v3/projects/b5a5170f0907491ebda6ed5f30ef9de2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:51.471330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:51.474250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:51.542650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe47dfe-e55a-411e-9f01-b7fe573183b1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:51.555230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:51.556705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:51.557084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:51.557438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] PATH_INFO: `/v3/users/df3af1f2ed0b40a9a85441307ac26fd4` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:51.558913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3af1f2ed0b40a9a85441307ac26fd4)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:51.562087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:51.607006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157eb87-be33-46ac-9223-7fa8c64371c6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:51.612761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:51.613438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:51.613718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:51.614024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] PATH_INFO: `/v3/users/5cdb2194a63045cabe6786a014277d89` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:51.615533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cdb2194a63045cabe6786a014277d89)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:51.617288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:51.651432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3af1f2ed0b40a9a85441307ac26fd4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.682487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3af1f2ed0b40a9a85441307ac26fd4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.682487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3af1f2ed0b40a9a85441307ac26fd4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.693931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3af1f2ed0b40a9a85441307ac26fd4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.694395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3af1f2ed0b40a9a85441307ac26fd4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.699748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cdb2194a63045cabe6786a014277d89'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.701848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:51.714523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cdb2194a63045cabe6786a014277d89'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.716796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cdb2194a63045cabe6786a014277d89'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.736973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cdb2194a63045cabe6786a014277d89'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.743632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 994/1983] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:51 2022] DELETE /identity/v3/users/df3af1f2ed0b40a9a85441307ac26fd4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:51.768073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cdb2194a63045cabe6786a014277d89'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:51.785970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 990/1984] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:51 2022] DELETE /identity/v3/users/5cdb2194a63045cabe6786a014277d89 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:51.930504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:51.932465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.020104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.022368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.086997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178cafb-231c-4571-85e6-af197053f97c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.124444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:52.181207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6bae-d73c-4233-9ab5-fd1e665584c0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.188428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.189211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.189642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.189993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] PATH_INFO: `/v3/projects/714ea1ecaf114266bcf83bdf55b9edfa` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.191765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714ea1ecaf114266bcf83bdf55b9edfa)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.193843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.209082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.209959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.210305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.210777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] PATH_INFO: `/v3/projects/98315899df8447b384ed85541886bb17` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.212168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98315899df8447b384ed85541886bb17)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.215249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.268038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714ea1ecaf114266bcf83bdf55b9edfa', 'request_id': 'req-9f117d0b-3aef-44c1-9fc1-8886b06d2974'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.277137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714ea1ecaf114266bcf83bdf55b9edfa', 'request_id': 'req-9f117d0b-3aef-44c1-9fc1-8886b06d2974'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.290292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714ea1ecaf114266bcf83bdf55b9edfa', 'request_id': 'req-9f117d0b-3aef-44c1-9fc1-8886b06d2974'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.295750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98315899df8447b384ed85541886bb17', 'request_id': 'req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.305959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98315899df8447b384ed85541886bb17', 'request_id': 'req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.309266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] The token cache is being invalidate because project 714ea1ecaf114266bcf83bdf55b9edfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:52.310204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.311286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.313492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 991/1985] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:52 2022] DELETE /identity/v3/projects/714ea1ecaf114266bcf83bdf55b9edfa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:52.313909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98315899df8447b384ed85541886bb17', 'request_id': 'req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.316357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.318658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.335549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] The token cache is being invalidate because project 98315899df8447b384ed85541886bb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:52.335939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.336877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ec08c2ee-b3cd-4ba7-af27-3972cd05bf96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.339098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 995/1986] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:51 2022] DELETE /identity/v3/projects/98315899df8447b384ed85541886bb17 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:52.344074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0eece-8a76-4ed4-bf05-2a14372cbfe5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.344363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0eece-8a76-4ed4-bf05-2a14372cbfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.344641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0eece-8a76-4ed4-bf05-2a14372cbfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.369391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-27a0eece-8a76-4ed4-bf05-2a14372cbfe5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:52.370595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-27a0eece-8a76-4ed4-bf05-2a14372cbfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.406991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:52.418306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117d0b-3aef-44c1-9fc1-8886b06d2974 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.456990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 996/1987] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:52.458433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ba04-a35d-4dd3-a112-8d08d3612434 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.458784 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ba04-a35d-4dd3-a112-8d08d3612434 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.459063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ba04-a35d-4dd3-a112-8d08d3612434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.487578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-70d0ba04-a35d-4dd3-a112-8d08d3612434 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:52.489304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-70d0ba04-a35d-4dd3-a112-8d08d3612434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.496902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 997/1988] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:52.498227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399579bd-a82f-48f9-9500-123a24946898 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.498600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399579bd-a82f-48f9-9500-123a24946898 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.498880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399579bd-a82f-48f9-9500-123a24946898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.511863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.512513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.512792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.513064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] PATH_INFO: `/v3/projects/83820ea566f04404a814af603a12a8ba` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.514210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83820ea566f04404a814af603a12a8ba)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.516162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.520729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-399579bd-a82f-48f9-9500-123a24946898 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:52.521943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-399579bd-a82f-48f9-9500-123a24946898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.530740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 998/1989] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:52.534297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21df0-3eea-480e-b66a-df88da1a4f0f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.534297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21df0-3eea-480e-b66a-df88da1a4f0f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.534297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21df0-3eea-480e-b66a-df88da1a4f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.554871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-54b21df0-3eea-480e-b66a-df88da1a4f0f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:52.556236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-54b21df0-3eea-480e-b66a-df88da1a4f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.573590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83820ea566f04404a814af603a12a8ba', 'request_id': 'req-52d8f273-d8a9-458c-ace9-2d6b75de3277'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.581501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83820ea566f04404a814af603a12a8ba', 'request_id': 'req-52d8f273-d8a9-458c-ace9-2d6b75de3277'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.594700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:52.595822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83820ea566f04404a814af603a12a8ba', 'request_id': 'req-52d8f273-d8a9-458c-ace9-2d6b75de3277'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.607905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] The token cache is being invalidate because project 83820ea566f04404a814af603a12a8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:52.608406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.609769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:52.611581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 992/1990] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:52 2022] DELETE /identity/v3/projects/83820ea566f04404a814af603a12a8ba => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:52.615976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.615976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.632448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 999/1991] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:52.633744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9728-817a-419e-b48d-b8da2154b1f5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.634920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9728-817a-419e-b48d-b8da2154b1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.635202 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9728-817a-419e-b48d-b8da2154b1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.656533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-836a9728-817a-419e-b48d-b8da2154b1f5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:52.658038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-836a9728-817a-419e-b48d-b8da2154b1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.666959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1000/1992] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:52.667888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a9728-817a-419e-b48d-b8da2154b1f5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.686082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a9728-817a-419e-b48d-b8da2154b1f5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.689839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f273-d8a9-458c-ace9-2d6b75de3277 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.691366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c5dc1-711f-4955-a80d-21f1509f7fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.691977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c5dc1-711f-4955-a80d-21f1509f7fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.692322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c5dc1-711f-4955-a80d-21f1509f7fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.692605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c5dc1-711f-4955-a80d-21f1509f7fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.693257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c5dc1-711f-4955-a80d-21f1509f7fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:52.693560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c5dc1-711f-4955-a80d-21f1509f7fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.695172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c5dc1-711f-4955-a80d-21f1509f7fd8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.695529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.696046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.696407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.696588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.697268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:52.697576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.699196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.709150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1001/1993] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:52.710398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b58b3-e1e1-40b9-a28e-320c64b9870f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.710689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b58b3-e1e1-40b9-a28e-320c64b9870f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.710964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b58b3-e1e1-40b9-a28e-320c64b9870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.712331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 993/1994] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:52.713279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.726985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511936b-1526-4a21-9bab-6c9e812d78f6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.732186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972bd4c-f2c9-45f8-9175-8ef9c9fddde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.732378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fc0b58b3-e1e1-40b9-a28e-320c64b9870f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:52.732991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972bd4c-f2c9-45f8-9175-8ef9c9fddde4 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.733371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972bd4c-f2c9-45f8-9175-8ef9c9fddde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.733808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972bd4c-f2c9-45f8-9175-8ef9c9fddde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.733914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fc0b58b3-e1e1-40b9-a28e-320c64b9870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.734605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972bd4c-f2c9-45f8-9175-8ef9c9fddde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.736623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972bd4c-f2c9-45f8-9175-8ef9c9fddde4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.744239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1002/1995] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:52.744754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b58b3-e1e1-40b9-a28e-320c64b9870f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.763479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b58b3-e1e1-40b9-a28e-320c64b9870f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.769010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492b5f-bad6-4d50-8647-96494911ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.769634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492b5f-bad6-4d50-8647-96494911ca7c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.769917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492b5f-bad6-4d50-8647-96494911ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.770193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492b5f-bad6-4d50-8647-96494911ca7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.771028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10492b5f-bad6-4d50-8647-96494911ca7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.772511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 994/1996] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:52.773704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972bd4c-f2c9-45f8-9175-8ef9c9fddde4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.776591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10492b5f-bad6-4d50-8647-96494911ca7c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.783518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:52.813374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1003/1997] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:52.814224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492b5f-bad6-4d50-8647-96494911ca7c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.853996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972bd4c-f2c9-45f8-9175-8ef9c9fddde4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.892173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492b5f-bad6-4d50-8647-96494911ca7c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.899103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283f921-dd56-486c-b2c2-d0f0909965eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.899875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f921-dd56-486c-b2c2-d0f0909965eb admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.900518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f921-dd56-486c-b2c2-d0f0909965eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.900796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f921-dd56-486c-b2c2-d0f0909965eb admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.901767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283f921-dd56-486c-b2c2-d0f0909965eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.903829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283f921-dd56-486c-b2c2-d0f0909965eb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.917687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.918422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.918741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.919064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.919857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:52.920187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.922223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.928797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1004/1998] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:52.929895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283f921-dd56-486c-b2c2-d0f0909965eb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.938178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 995/1999] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:52.939366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.939855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283f921-dd56-486c-b2c2-d0f0909965eb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.941292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:52.945076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcedb1-f2e9-4b92-a798-33c781a234cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.945698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcedb1-f2e9-4b92-a798-33c781a234cb admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.945980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcedb1-f2e9-4b92-a798-33c781a234cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.946252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcedb1-f2e9-4b92-a798-33c781a234cb admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.946912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcedb1-f2e9-4b92-a798-33c781a234cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.948901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcedb1-f2e9-4b92-a798-33c781a234cb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.954486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f72ac-2b6a-4d8b-99a1-fafc7709df5a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.959528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.960106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.960393 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.960818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] PATH_INFO: `/v3/users/ace8f58b44df4e429b953813829b0bc1` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.962002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace8f58b44df4e429b953813829b0bc1)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.964256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:52.972622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1005/2000] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:52 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:52.973731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcedb1-f2e9-4b92-a798-33c781a234cb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:52.983623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcedb1-f2e9-4b92-a798-33c781a234cb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:52.989511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea344bf-ca05-4413-987c-47490a51dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:52.990144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea344bf-ca05-4413-987c-47490a51dddc admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:52.990467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea344bf-ca05-4413-987c-47490a51dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:52.990746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea344bf-ca05-4413-987c-47490a51dddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:52.991398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea344bf-ca05-4413-987c-47490a51dddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:52.993010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea344bf-ca05-4413-987c-47490a51dddc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.006194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1006/2001] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:53.007466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea344bf-ca05-4413-987c-47490a51dddc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.021941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea344bf-ca05-4413-987c-47490a51dddc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.026972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bd2d6-233a-4da6-8f69-99ae9c494636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.027621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bd2d6-233a-4da6-8f69-99ae9c494636 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.027902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bd2d6-233a-4da6-8f69-99ae9c494636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.028177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bd2d6-233a-4da6-8f69-99ae9c494636 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.028965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bd2d6-233a-4da6-8f69-99ae9c494636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.030743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace8f58b44df4e429b953813829b0bc1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:53.030936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bd2d6-233a-4da6-8f69-99ae9c494636 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.039537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace8f58b44df4e429b953813829b0bc1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:53.040719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace8f58b44df4e429b953813829b0bc1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:53.053479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace8f58b44df4e429b953813829b0bc1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:53.070052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1007/2002] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:53 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:53.070052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bd2d6-233a-4da6-8f69-99ae9c494636 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.070380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace8f58b44df4e429b953813829b0bc1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:53.076898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 996/2003] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:52 2022] DELETE /identity/v3/users/ace8f58b44df4e429b953813829b0bc1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:53.078571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.079832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.109213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:53.128250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:53.165410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531821f-5ce7-4c83-a306-414968049106 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.168284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bd2d6-233a-4da6-8f69-99ae9c494636 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.170454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.171140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.171439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.171805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.172460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.173644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cada5-2fbb-43e9-9ec6-ae4b9a612e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.174088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.174338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cada5-2fbb-43e9-9ec6-ae4b9a612e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.174663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cada5-2fbb-43e9-9ec6-ae4b9a612e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.175454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cada5-2fbb-43e9-9ec6-ae4b9a612e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.176331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cada5-2fbb-43e9-9ec6-ae4b9a612e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.177958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cada5-2fbb-43e9-9ec6-ae4b9a612e16 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.185721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 997/2004] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:53.186610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.188406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.193017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1008/2005] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:53.194519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ede4b-94f8-4aee-8f7c-955a1cb33d71 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.194812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ede4b-94f8-4aee-8f7c-955a1cb33d71 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.195092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ede4b-94f8-4aee-8f7c-955a1cb33d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.201887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217d0ba-80f7-471d-9673-eb436c3c85b7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.207654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.208540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.208834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.209144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.209904 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.211853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.215974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-865ede4b-94f8-4aee-8f7c-955a1cb33d71 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:53.217212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-865ede4b-94f8-4aee-8f7c-955a1cb33d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.226344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1009/2006] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:53.227270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ede4b-94f8-4aee-8f7c-955a1cb33d71 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.238785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ede4b-94f8-4aee-8f7c-955a1cb33d71 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.243963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.244650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.244847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 998/2007] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:53 2022] POST /identity/v3/users => generated 294 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:53.246032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.246528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.247067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] PATH_INFO: `/v3/projects/3f0cc9b39b254c2f9427fe3932b0e8a1/users/435831336d4041768c5d4733fca4009f/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.249035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.262802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629d6c6-e95c-47a4-811b-d2db87d27132 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.264367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0cc9b39b254c2f9427fe3932b0e8a1, user_id=435831336d4041768c5d4733fca4009f, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.267599 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.269625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de023d-68d7-4234-8209-1437e4ad2d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.270512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de023d-68d7-4234-8209-1437e4ad2d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.270915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de023d-68d7-4234-8209-1437e4ad2d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.271326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de023d-68d7-4234-8209-1437e4ad2d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.272091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de023d-68d7-4234-8209-1437e4ad2d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.274497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de023d-68d7-4234-8209-1437e4ad2d27 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.287831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1010/2008] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:53 2022] PUT /identity/v3/projects/3f0cc9b39b254c2f9427fe3932b0e8a1/users/435831336d4041768c5d4733fca4009f/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:53.297116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.299372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.304572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 999/2009] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:53.304572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de023d-68d7-4234-8209-1437e4ad2d27 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.319453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de023d-68d7-4234-8209-1437e4ad2d27 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.376117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be72a8-ba7d-4ffa-b48a-98cc43bca4ad admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.381442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732cd38-0ff9-4db9-8b4f-6dd33d9fdd87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.381986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732cd38-0ff9-4db9-8b4f-6dd33d9fdd87 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.382294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732cd38-0ff9-4db9-8b4f-6dd33d9fdd87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.382558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732cd38-0ff9-4db9-8b4f-6dd33d9fdd87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.385521 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafe614-c672-4580-b4de-b91be2194d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.386340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe614-c672-4580-b4de-b91be2194d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.386570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe614-c672-4580-b4de-b91be2194d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.386896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafe614-c672-4580-b4de-b91be2194d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.387536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafe614-c672-4580-b4de-b91be2194d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.389479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafe614-c672-4580-b4de-b91be2194d99 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.394062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732cd38-0ff9-4db9-8b4f-6dd33d9fdd87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.395604 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732cd38-0ff9-4db9-8b4f-6dd33d9fdd87 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.401845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1000/2010] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:53.403152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1f2f-caaf-4e95-a795-2ee10f3d34cc None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.403440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1f2f-caaf-4e95-a795-2ee10f3d34cc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.403714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1f2f-caaf-4e95-a795-2ee10f3d34cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.406394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1011/2011] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:53.407272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732cd38-0ff9-4db9-8b4f-6dd33d9fdd87 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.419182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732cd38-0ff9-4db9-8b4f-6dd33d9fdd87 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.423984 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638cdc4-747d-43ee-ab1d-84fd8a37b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.424707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638cdc4-747d-43ee-ab1d-84fd8a37b81b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.424992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638cdc4-747d-43ee-ab1d-84fd8a37b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.425591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638cdc4-747d-43ee-ab1d-84fd8a37b81b admin admin] PATH_INFO: `/v3/projects/d413cb18c64c42ef99af5445b08341e1/users/181c037e29df48609a5f1c560dfcb5d1/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.448552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-418b1f2f-caaf-4e95-a795-2ee10f3d34cc None None] MFA Rules not processed for user `435831336d4041768c5d4733fca4009f`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:53.450779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-418b1f2f-caaf-4e95-a795-2ee10f3d34cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.453222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638cdc4-747d-43ee-ab1d-84fd8a37b81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d413cb18c64c42ef99af5445b08341e1, user_id=181c037e29df48609a5f1c560dfcb5d1, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.458957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638cdc4-747d-43ee-ab1d-84fd8a37b81b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.494380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1012/2012] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:53 2022] PUT /identity/v3/projects/d413cb18c64c42ef99af5445b08341e1/users/181c037e29df48609a5f1c560dfcb5d1/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:53.494380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638cdc4-747d-43ee-ab1d-84fd8a37b81b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.590374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1001/2013] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:53.590374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917538-8052-4b90-a99a-b097f48d06c4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.590749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917538-8052-4b90-a99a-b097f48d06c4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.591439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917538-8052-4b90-a99a-b097f48d06c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.600375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638cdc4-747d-43ee-ab1d-84fd8a37b81b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.606496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.607007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.607292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.607593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.608247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.609946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.625331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1013/2014] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:53.629723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.632365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.651124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:53.659710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:53.665045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ca917538-8052-4b90-a99a-b097f48d06c4 None None] MFA Rules not processed for user `181c037e29df48609a5f1c560dfcb5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:53.671687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ca917538-8052-4b90-a99a-b097f48d06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.714402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d349b-7b12-4e8c-af6b-e3ed858659ba admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.718395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.719029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.719464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.719619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.760301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1002/2015] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:53.760301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca917538-8052-4b90-a99a-b097f48d06c4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.777469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca917538-8052-4b90-a99a-b097f48d06c4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.784934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.785606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.785886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.786160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] PATH_INFO: `/v3/projects/61968cf16ada4ebda4f46842cd042db6/users/2462388804d64468a7c8f98b155d2acd/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.805447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61968cf16ada4ebda4f46842cd042db6, user_id=2462388804d64468a7c8f98b155d2acd, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.808805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.818382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.819994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:53.832322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1014/2016] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:53.833208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.835013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.849465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8121-a1ad-4b4b-b1e8-ffbc05a8c1f3 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.862542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1003/2017] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:53 2022] PUT /identity/v3/projects/61968cf16ada4ebda4f46842cd042db6/users/2462388804d64468a7c8f98b155d2acd/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:53.863973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:53.871325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:53.933738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ea3d3-1cfe-46e4-a12d-c67c1c4e8335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.934802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea3d3-1cfe-46e4-a12d-c67c1c4e8335 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.934802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea3d3-1cfe-46e4-a12d-c67c1c4e8335 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.934995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea3d3-1cfe-46e4-a12d-c67c1c4e8335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.953921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163564e-390d-4460-a4a2-2625d9a310b4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:53.962129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:53.962967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:53.963527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:53.963807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] PATH_INFO: `/v3/projects/e607942ded474f848853df6a6cb7af6b` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:53.964962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e607942ded474f848853df6a6cb7af6b)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:53.966910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.005045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ea3d3-1cfe-46e4-a12d-c67c1c4e8335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.006791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ea3d3-1cfe-46e4-a12d-c67c1c4e8335 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.021290 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1015/2018] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:54.023093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0ac4a-0458-4e3d-82e4-f4011d1ccb1e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.023093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0ac4a-0458-4e3d-82e4-f4011d1ccb1e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.023443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0ac4a-0458-4e3d-82e4-f4011d1ccb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.027766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e607942ded474f848853df6a6cb7af6b', 'request_id': 'req-a5783f0c-b344-4c99-bdf2-16da5db0121c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.042686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e607942ded474f848853df6a6cb7af6b', 'request_id': 'req-a5783f0c-b344-4c99-bdf2-16da5db0121c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.047290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e607942ded474f848853df6a6cb7af6b', 'request_id': 'req-a5783f0c-b344-4c99-bdf2-16da5db0121c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.061077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] The token cache is being invalidate because project e607942ded474f848853df6a6cb7af6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:54.061276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f1a0ac4a-0458-4e3d-82e4-f4011d1ccb1e None None] MFA Rules not processed for user `2462388804d64468a7c8f98b155d2acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:54.061829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.062579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f1a0ac4a-0458-4e3d-82e4-f4011d1ccb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.062843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.064572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1004/2019] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:53 2022] DELETE /identity/v3/projects/e607942ded474f848853df6a6cb7af6b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:54.068412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.068412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.071744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:54.080810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:54.149488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1016/2020] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:54.149488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0ac4a-0458-4e3d-82e4-f4011d1ccb1e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.156523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5783f0c-b344-4c99-bdf2-16da5db0121c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.161824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f1a0ac4a-0458-4e3d-82e4-f4011d1ccb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.167966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.168758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.169117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.169346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] PATH_INFO: `/v3/users/181c037e29df48609a5f1c560dfcb5d1` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.181213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181c037e29df48609a5f1c560dfcb5d1)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.183268 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.194827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0ac4a-0458-4e3d-82e4-f4011d1ccb1e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.207451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.208229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.208574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.210333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] PATH_INFO: `/v3/users/1f33ad48e0dc4eb6993fa761987258c3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.212497 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f33ad48e0dc4eb6993fa761987258c3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.214492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.266166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181c037e29df48609a5f1c560dfcb5d1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.277182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181c037e29df48609a5f1c560dfcb5d1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.278129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181c037e29df48609a5f1c560dfcb5d1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.288002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181c037e29df48609a5f1c560dfcb5d1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.303028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181c037e29df48609a5f1c560dfcb5d1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.303632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f33ad48e0dc4eb6993fa761987258c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.311173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f33ad48e0dc4eb6993fa761987258c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.311887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f33ad48e0dc4eb6993fa761987258c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.313133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1005/2021] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:54 2022] DELETE /identity/v3/users/181c037e29df48609a5f1c560dfcb5d1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:54.314194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.317980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.321917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f33ad48e0dc4eb6993fa761987258c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.322629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3a254552-4e26-4b25-8605-b6060563d711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f33ad48e0dc4eb6993fa761987258c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.359332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1017/2022] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:54 2022] DELETE /identity/v3/users/1f33ad48e0dc4eb6993fa761987258c3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:54.361459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8455c-8f1e-4bd0-aced-d50784db007d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.361981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8455c-8f1e-4bd0-aced-d50784db007d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.362986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8455c-8f1e-4bd0-aced-d50784db007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.401334 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0dd8455c-8f1e-4bd0-aced-d50784db007d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:54.402652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0dd8455c-8f1e-4bd0-aced-d50784db007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.407533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590a450-da0a-45a4-a8bb-b2ef901239a4 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.497887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:54.510307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1018/2023] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:54.517670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8455c-8f1e-4bd0-aced-d50784db007d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.519969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0dd8455c-8f1e-4bd0-aced-d50784db007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.544016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:54.549368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.551215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.551514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.552356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.552546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.555108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.595207 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1006/2024] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:54 2022] POST /identity/v3/projects => generated 387 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:54.607618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.610753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.620931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8455c-8f1e-4bd0-aced-d50784db007d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.702103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4fb76-2a74-441b-b7c1-f98ecf3c6644 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.706490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9bf05-72c0-4749-9c85-b6d2044738b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.707288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bf05-72c0-4749-9c85-b6d2044738b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.707404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bf05-72c0-4749-9c85-b6d2044738b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.707678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bf05-72c0-4749-9c85-b6d2044738b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.711085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0c2a6-0abe-403e-b25a-52c57fee906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.711878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0c2a6-0abe-403e-b25a-52c57fee906a admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.712178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0c2a6-0abe-403e-b25a-52c57fee906a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.712508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0c2a6-0abe-403e-b25a-52c57fee906a admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.713228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0c2a6-0abe-403e-b25a-52c57fee906a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.715406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0c2a6-0abe-403e-b25a-52c57fee906a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.742046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9bf05-72c0-4749-9c85-b6d2044738b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.745520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1007/2025] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:54 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:54.745912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9bf05-72c0-4749-9c85-b6d2044738b7 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.749548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0c2a6-0abe-403e-b25a-52c57fee906a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.762966 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1019/2026] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:54.764573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0c2a6-0abe-403e-b25a-52c57fee906a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.771714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.772257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.772544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.772891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.773703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.775370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.788755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1008/2027] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:54.795446 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9bf05-72c0-4749-9c85-b6d2044738b7 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.806563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9bf05-72c0-4749-9c85-b6d2044738b7 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.812933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668290-ad51-4bb8-8dc8-972a624f12b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.813768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668290-ad51-4bb8-8dc8-972a624f12b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.813928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668290-ad51-4bb8-8dc8-972a624f12b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.814113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668290-ad51-4bb8-8dc8-972a624f12b0 admin admin] PATH_INFO: `/v3/projects/902d76ebc3ca4039bd62dae5a7431d20/users/5639351a00e8492d804672c4a231543c/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.832968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98668290-ad51-4bb8-8dc8-972a624f12b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902d76ebc3ca4039bd62dae5a7431d20, user_id=5639351a00e8492d804672c4a231543c, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.835668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98668290-ad51-4bb8-8dc8-972a624f12b0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.851231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1020/2028] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:54 2022] PUT /identity/v3/projects/902d76ebc3ca4039bd62dae5a7431d20/users/5639351a00e8492d804672c4a231543c/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:54.854689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.857076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668290-ad51-4bb8-8dc8-972a624f12b0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.857576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.873056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25067a83-46e8-4440-80c2-9e89860ae1ca admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.937518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668290-ad51-4bb8-8dc8-972a624f12b0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.946977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ded6-11e0-4f00-88ad-60b179c92905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.948408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ded6-11e0-4f00-88ad-60b179c92905 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.948941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ded6-11e0-4f00-88ad-60b179c92905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.949380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ded6-11e0-4f00-88ad-60b179c92905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.950571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66ded6-11e0-4f00-88ad-60b179c92905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.954596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66ded6-11e0-4f00-88ad-60b179c92905 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.975597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1021/2029] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:54.976619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ded6-11e0-4f00-88ad-60b179c92905 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.984429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.985342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.986046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.986642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] PATH_INFO: `/v3/projects/529a43cbb4144cb4b4f53263881f258e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.987330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ded6-11e0-4f00-88ad-60b179c92905 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.993309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=529a43cbb4144cb4b4f53263881f258e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.993517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dd864-2f9d-4b16-959b-1f518c9f9631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.994630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd864-2f9d-4b16-959b-1f518c9f9631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.994914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd864-2f9d-4b16-959b-1f518c9f9631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.995186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd864-2f9d-4b16-959b-1f518c9f9631 admin admin] PATH_INFO: `/v3/projects/902d76ebc3ca4039bd62dae5a7431d20/users/5639351a00e8492d804672c4a231543c/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.995537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.997213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dd864-2f9d-4b16-959b-1f518c9f9631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902d76ebc3ca4039bd62dae5a7431d20, user_id=5639351a00e8492d804672c4a231543c, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.000139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dd864-2f9d-4b16-959b-1f518c9f9631 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.012452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1022/2030] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:54 2022] PUT /identity/v3/projects/902d76ebc3ca4039bd62dae5a7431d20/users/5639351a00e8492d804672c4a231543c/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:55.025350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d717479-370e-4bd3-b413-39786951dcd2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.025546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d717479-370e-4bd3-b413-39786951dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.025813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d717479-370e-4bd3-b413-39786951dcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.061816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0d717479-370e-4bd3-b413-39786951dcd2 None None] MFA Rules not processed for user `5639351a00e8492d804672c4a231543c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:55.063094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d717479-370e-4bd3-b413-39786951dcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.064496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:55.077067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529a43cbb4144cb4b4f53263881f258e', 'request_id': 'req-8bc216f3-3c8c-4e98-8060-796bc7370153'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.095381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529a43cbb4144cb4b4f53263881f258e', 'request_id': 'req-8bc216f3-3c8c-4e98-8060-796bc7370153'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.104884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529a43cbb4144cb4b4f53263881f258e', 'request_id': 'req-8bc216f3-3c8c-4e98-8060-796bc7370153'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.106967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:55.124282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] The token cache is being invalidate because project 529a43cbb4144cb4b4f53263881f258e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:55.124282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.125061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8bc216f3-3c8c-4e98-8060-796bc7370153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.130799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1009/2031] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:54 2022] DELETE /identity/v3/projects/529a43cbb4144cb4b4f53263881f258e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:55.136368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fa62-874f-482f-91d2-b603c8ca3e32 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.136657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fa62-874f-482f-91d2-b603c8ca3e32 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.136934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fa62-874f-482f-91d2-b603c8ca3e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.158217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3d74fa62-874f-482f-91d2-b603c8ca3e32 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:55.160259 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3d74fa62-874f-482f-91d2-b603c8ca3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.184521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1023/2032] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:55.192587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d717479-370e-4bd3-b413-39786951dcd2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.195281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d717479-370e-4bd3-b413-39786951dcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.228986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1010/2033] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:55.230010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74fa62-874f-482f-91d2-b603c8ca3e32 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.231471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3d74fa62-874f-482f-91d2-b603c8ca3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.305118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d717479-370e-4bd3-b413-39786951dcd2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.312798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74fa62-874f-482f-91d2-b603c8ca3e32 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.313252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.314167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.314782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.315791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] PATH_INFO: `/v3/projects/d413cb18c64c42ef99af5445b08341e1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.318727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7710-48d4-4938-92bf-6f3c2f829db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.319034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d413cb18c64c42ef99af5445b08341e1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.320030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7710-48d4-4938-92bf-6f3c2f829db5 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.320634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7710-48d4-4938-92bf-6f3c2f829db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.321015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.321380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7710-48d4-4938-92bf-6f3c2f829db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.345821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded7710-48d4-4938-92bf-6f3c2f829db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.349051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded7710-48d4-4938-92bf-6f3c2f829db5 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.369864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1011/2034] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:55.371633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0d4c-cce1-47ae-9fed-78f5e5ffbae7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.372023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0d4c-cce1-47ae-9fed-78f5e5ffbae7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.372330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0d4c-cce1-47ae-9fed-78f5e5ffbae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.410609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd413cb18c64c42ef99af5445b08341e1', 'request_id': 'req-9c6af79b-6d05-448a-abbb-b3fefb10df48'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.411990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5d7e0d4c-cce1-47ae-9fed-78f5e5ffbae7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:55.414491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5d7e0d4c-cce1-47ae-9fed-78f5e5ffbae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.419032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd413cb18c64c42ef99af5445b08341e1', 'request_id': 'req-9c6af79b-6d05-448a-abbb-b3fefb10df48'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.429955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd413cb18c64c42ef99af5445b08341e1', 'request_id': 'req-9c6af79b-6d05-448a-abbb-b3fefb10df48'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.464786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] The token cache is being invalidate because project d413cb18c64c42ef99af5445b08341e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:55.465169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.471080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c6af79b-6d05-448a-abbb-b3fefb10df48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.478739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1024/2035] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:55 2022] DELETE /identity/v3/projects/d413cb18c64c42ef99af5445b08341e1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:55.486067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c902e-31f0-460d-a606-2735f4282a47 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.486395 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c902e-31f0-460d-a606-2735f4282a47 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.488052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c902e-31f0-460d-a606-2735f4282a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.522884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1012/2036] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:55.523696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0d4c-cce1-47ae-9fed-78f5e5ffbae7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.525060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5d7e0d4c-cce1-47ae-9fed-78f5e5ffbae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.529014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-532c902e-31f0-460d-a606-2735f4282a47 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:55.530288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-532c902e-31f0-460d-a606-2735f4282a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.539267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0d4c-cce1-47ae-9fed-78f5e5ffbae7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.540170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1025/2037] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:55.541139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c902e-31f0-460d-a606-2735f4282a47 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.552666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.553051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c902e-31f0-460d-a606-2735f4282a47 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.553270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.553572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.553822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] PATH_INFO: `/v3/users/2462388804d64468a7c8f98b155d2acd` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.555059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2462388804d64468a7c8f98b155d2acd)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.557475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.559386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2617cc-9130-44d2-9a08-e4036ad86ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.559386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2617cc-9130-44d2-9a08-e4036ad86ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.559763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2617cc-9130-44d2-9a08-e4036ad86ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.559763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2617cc-9130-44d2-9a08-e4036ad86ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.560419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2617cc-9130-44d2-9a08-e4036ad86ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:55.560900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2617cc-9130-44d2-9a08-e4036ad86ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.562665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2617cc-9130-44d2-9a08-e4036ad86ed8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.573474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:55.582783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1026/2038] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:55.590363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088420b9-4e51-4d68-a75f-dd524e5cbe13 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.590658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088420b9-4e51-4d68-a75f-dd524e5cbe13 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.590941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088420b9-4e51-4d68-a75f-dd524e5cbe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.633271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-088420b9-4e51-4d68-a75f-dd524e5cbe13 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:55.634835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-088420b9-4e51-4d68-a75f-dd524e5cbe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.647038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1027/2039] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:55.648219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088420b9-4e51-4d68-a75f-dd524e5cbe13 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.659823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088420b9-4e51-4d68-a75f-dd524e5cbe13 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.665320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bcb97-8640-498b-a295-7605675db7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.666103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bcb97-8640-498b-a295-7605675db7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.666435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bcb97-8640-498b-a295-7605675db7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.667097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bcb97-8640-498b-a295-7605675db7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.667474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bcb97-8640-498b-a295-7605675db7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.669185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2462388804d64468a7c8f98b155d2acd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.669490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bcb97-8640-498b-a295-7605675db7e1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.679980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2462388804d64468a7c8f98b155d2acd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.681102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2462388804d64468a7c8f98b155d2acd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.694077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2462388804d64468a7c8f98b155d2acd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.708448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2462388804d64468a7c8f98b155d2acd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.715534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1013/2040] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:55 2022] DELETE /identity/v3/users/2462388804d64468a7c8f98b155d2acd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:55.716326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.717990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.722822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1028/2041] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:55.724087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc387-9e00-41d4-a962-8a8627bce177 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.726633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc387-9e00-41d4-a962-8a8627bce177 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.727018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc387-9e00-41d4-a962-8a8627bce177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.735615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:55.750947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-612cc387-9e00-41d4-a962-8a8627bce177 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:55.752980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-612cc387-9e00-41d4-a962-8a8627bce177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.807143 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edbabc-c757-441d-936b-094cfe4578fa admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.844390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1029/2042] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:55.845939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cc387-9e00-41d4-a962-8a8627bce177 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.848162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-612cc387-9e00-41d4-a962-8a8627bce177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.868079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cc387-9e00-41d4-a962-8a8627bce177 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.876774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84a0de-972b-4fd0-bb72-dfd6b8e1ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.878805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84a0de-972b-4fd0-bb72-dfd6b8e1ad02 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.879746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84a0de-972b-4fd0-bb72-dfd6b8e1ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.880245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84a0de-972b-4fd0-bb72-dfd6b8e1ad02 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.881440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84a0de-972b-4fd0-bb72-dfd6b8e1ad02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.884982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.885363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84a0de-972b-4fd0-bb72-dfd6b8e1ad02 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.885621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.885905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.886183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.886978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:55.887480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.889216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.905190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1014/2043] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:55.906376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.908576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.919345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1030/2044] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/users => generated 286 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:55.920400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84a0de-972b-4fd0-bb72-dfd6b8e1ad02 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.932783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84a0de-972b-4fd0-bb72-dfd6b8e1ad02 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.938151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500628-61eb-42f4-8d47-e141de9b32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.938814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500628-61eb-42f4-8d47-e141de9b32f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.939099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500628-61eb-42f4-8d47-e141de9b32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.939378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500628-61eb-42f4-8d47-e141de9b32f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.940040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f500628-61eb-42f4-8d47-e141de9b32f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.942224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f500628-61eb-42f4-8d47-e141de9b32f6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.947243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:55.983778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1031/2045] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:55 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:55.983778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500628-61eb-42f4-8d47-e141de9b32f6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.993729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231abf14-aa02-4ab3-a03d-af7cc42f639c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.056016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02426e-1ce4-4de3-9adf-62a191d7c8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.059960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02426e-1ce4-4de3-9adf-62a191d7c8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.060844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02426e-1ce4-4de3-9adf-62a191d7c8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.061279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02426e-1ce4-4de3-9adf-62a191d7c8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.068397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500628-61eb-42f4-8d47-e141de9b32f6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.073062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02426e-1ce4-4de3-9adf-62a191d7c8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.077889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618345-3243-4991-b7ce-30a289b6df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.077889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618345-3243-4991-b7ce-30a289b6df2f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.078177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02426e-1ce4-4de3-9adf-62a191d7c8c9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.078294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618345-3243-4991-b7ce-30a289b6df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.078294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97618345-3243-4991-b7ce-30a289b6df2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.078294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618345-3243-4991-b7ce-30a289b6df2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.079118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97618345-3243-4991-b7ce-30a289b6df2f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.093016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1015/2046] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:56.093680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02426e-1ce4-4de3-9adf-62a191d7c8c9 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.106909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1032/2047] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:56.108701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02426e-1ce4-4de3-9adf-62a191d7c8c9 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.113348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618345-3243-4991-b7ce-30a289b6df2f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.118006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38820e-cf52-48f7-bf87-cc2ea13662bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.118675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38820e-cf52-48f7-bf87-cc2ea13662bb admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.118958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38820e-cf52-48f7-bf87-cc2ea13662bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.119238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38820e-cf52-48f7-bf87-cc2ea13662bb admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.120360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38820e-cf52-48f7-bf87-cc2ea13662bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.123203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38820e-cf52-48f7-bf87-cc2ea13662bb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.126134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97618345-3243-4991-b7ce-30a289b6df2f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.133133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929b71-b7b3-4b20-926a-907913b49a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.135404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929b71-b7b3-4b20-926a-907913b49a77 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.135404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929b71-b7b3-4b20-926a-907913b49a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.135404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929b71-b7b3-4b20-926a-907913b49a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.135404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929b71-b7b3-4b20-926a-907913b49a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.137031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929b71-b7b3-4b20-926a-907913b49a77 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.161881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1016/2048] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:56 2022] POST /identity/v3/users => generated 293 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:56.163185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38820e-cf52-48f7-bf87-cc2ea13662bb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.173640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1033/2049] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:56.178608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38820e-cf52-48f7-bf87-cc2ea13662bb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.179842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929b71-b7b3-4b20-926a-907913b49a77 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.185186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58ea10-a097-4626-82ca-e9ec97bae17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.186394 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58ea10-a097-4626-82ca-e9ec97bae17f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.186898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58ea10-a097-4626-82ca-e9ec97bae17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.187447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58ea10-a097-4626-82ca-e9ec97bae17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.188339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58ea10-a097-4626-82ca-e9ec97bae17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.191101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58ea10-a097-4626-82ca-e9ec97bae17f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.199649 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929b71-b7b3-4b20-926a-907913b49a77 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.203402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1017/2050] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:56.207649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58ea10-a097-4626-82ca-e9ec97bae17f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.208875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d26c6-99c9-48e3-ad2a-ff582d0a14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.209997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d26c6-99c9-48e3-ad2a-ff582d0a14f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.212795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d26c6-99c9-48e3-ad2a-ff582d0a14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.212795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d26c6-99c9-48e3-ad2a-ff582d0a14f8 admin admin] PATH_INFO: `/v3/projects/b464ddedeb3b4109b5558c8b32705ef9/users/43c32915a7aa40dcb02a2eea277acfe6/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.223575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58ea10-a097-4626-82ca-e9ec97bae17f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.229165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f8ca0-7516-4033-b7e4-5c1957337768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.230299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f8ca0-7516-4033-b7e4-5c1957337768 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.230789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f8ca0-7516-4033-b7e4-5c1957337768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.231239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f8ca0-7516-4033-b7e4-5c1957337768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.231898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f8ca0-7516-4033-b7e4-5c1957337768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.234235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f8ca0-7516-4033-b7e4-5c1957337768 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.247649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1018/2051] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:56.250103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d26c6-99c9-48e3-ad2a-ff582d0a14f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b464ddedeb3b4109b5558c8b32705ef9, user_id=43c32915a7aa40dcb02a2eea277acfe6, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.252972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f8ca0-7516-4033-b7e4-5c1957337768 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.262481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d26c6-99c9-48e3-ad2a-ff582d0a14f8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.273879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f8ca0-7516-4033-b7e4-5c1957337768 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.286529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1034/2052] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:56 2022] PUT /identity/v3/projects/b464ddedeb3b4109b5558c8b32705ef9/users/43c32915a7aa40dcb02a2eea277acfe6/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:56.294174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8e60-d3e0-4a23-bd0d-db76544bb539 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.294573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8e60-d3e0-4a23-bd0d-db76544bb539 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.294864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8e60-d3e0-4a23-bd0d-db76544bb539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.327399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2a0a8e60-d3e0-4a23-bd0d-db76544bb539 None None] MFA Rules not processed for user `43c32915a7aa40dcb02a2eea277acfe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:56.328717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2a0a8e60-d3e0-4a23-bd0d-db76544bb539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:56.353666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:56.359851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4191cca-d46c-4d34-98af-05762eb423a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.361010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4191cca-d46c-4d34-98af-05762eb423a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.361318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4191cca-d46c-4d34-98af-05762eb423a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.361604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4191cca-d46c-4d34-98af-05762eb423a0 admin admin] PATH_INFO: `/v3/projects/13a0df064509401aaaed3762a9495eb8/users/9f1563d6881b4adeaf10a354da3ccb60/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.382341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4191cca-d46c-4d34-98af-05762eb423a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a0df064509401aaaed3762a9495eb8, user_id=9f1563d6881b4adeaf10a354da3ccb60, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.385515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4191cca-d46c-4d34-98af-05762eb423a0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.404920 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1019/2053] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:56 2022] PUT /identity/v3/projects/13a0df064509401aaaed3762a9495eb8/users/9f1563d6881b4adeaf10a354da3ccb60/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:56.416007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e176d-fbf1-46b3-8766-05b7724010d0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.416293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e176d-fbf1-46b3-8766-05b7724010d0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.416562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e176d-fbf1-46b3-8766-05b7724010d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.459019 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b54e176d-fbf1-46b3-8766-05b7724010d0 None None] MFA Rules not processed for user `9f1563d6881b4adeaf10a354da3ccb60`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:56.460281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b54e176d-fbf1-46b3-8766-05b7724010d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:56.461312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1035/2054] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:56.478873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a8e60-d3e0-4a23-bd0d-db76544bb539 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.480430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2a0a8e60-d3e0-4a23-bd0d-db76544bb539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:56.485367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:56.560841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1020/2055] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:56.561975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e176d-fbf1-46b3-8766-05b7724010d0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.566719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b54e176d-fbf1-46b3-8766-05b7724010d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:56.616656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a8e60-d3e0-4a23-bd0d-db76544bb539 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.652217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e176d-fbf1-46b3-8766-05b7724010d0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.657783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.658474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.658758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.659770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] PATH_INFO: `/v3/projects/61968cf16ada4ebda4f46842cd042db6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.661100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61968cf16ada4ebda4f46842cd042db6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.663077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.689596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db14ba-afda-4882-af6b-8c0ee0e380d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9452756fb5049678dd3aac0d5be651d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.690914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db14ba-afda-4882-af6b-8c0ee0e380d5 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.691321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db14ba-afda-4882-af6b-8c0ee0e380d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.691603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db14ba-afda-4882-af6b-8c0ee0e380d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.727061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61968cf16ada4ebda4f46842cd042db6', 'request_id': 'req-640f75a6-a4a3-40d9-b10b-df168570fdc0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.734462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61968cf16ada4ebda4f46842cd042db6', 'request_id': 'req-640f75a6-a4a3-40d9-b10b-df168570fdc0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.745803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61968cf16ada4ebda4f46842cd042db6', 'request_id': 'req-640f75a6-a4a3-40d9-b10b-df168570fdc0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.761191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] The token cache is being invalidate because project 61968cf16ada4ebda4f46842cd042db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:56.761490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.762505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.768918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1021/2056] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:56 2022] DELETE /identity/v3/projects/61968cf16ada4ebda4f46842cd042db6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:56.768918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.768918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:56.780338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db14ba-afda-4882-af6b-8c0ee0e380d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.781809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db14ba-afda-4882-af6b-8c0ee0e380d5 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.796359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1036/2057] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:56.797794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db14ba-afda-4882-af6b-8c0ee0e380d5 service glance] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.805442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:56.811342 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db14ba-afda-4882-af6b-8c0ee0e380d5 service glance] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.832337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:56.876645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f75a6-a4a3-40d9-b10b-df168570fdc0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.884942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba24be-5a74-499d-95a1-a9a56ed2d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.885831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba24be-5a74-499d-95a1-a9a56ed2d01f admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.886449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba24be-5a74-499d-95a1-a9a56ed2d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.886870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba24be-5a74-499d-95a1-a9a56ed2d01f admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.888000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba24be-5a74-499d-95a1-a9a56ed2d01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.890411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba24be-5a74-499d-95a1-a9a56ed2d01f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.911339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.912021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.912609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.912896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] PATH_INFO: `/v3/users/5639351a00e8492d804672c4a231543c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.914102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5639351a00e8492d804672c4a231543c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.916244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.937564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1022/2058] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:56 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:56.941929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba24be-5a74-499d-95a1-a9a56ed2d01f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.992991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5639351a00e8492d804672c4a231543c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.005275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5639351a00e8492d804672c4a231543c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.007706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5639351a00e8492d804672c4a231543c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.019688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5639351a00e8492d804672c4a231543c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.021301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5639351a00e8492d804672c4a231543c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.046785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba24be-5a74-499d-95a1-a9a56ed2d01f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.053793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1037/2059] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:56 2022] DELETE /identity/v3/users/5639351a00e8492d804672c4a231543c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:57.065929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2259956-5974-47cd-9bf5-ab3f64533157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.070419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2259956-5974-47cd-9bf5-ab3f64533157 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.070850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2259956-5974-47cd-9bf5-ab3f64533157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.071317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2259956-5974-47cd-9bf5-ab3f64533157 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.072744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2259956-5974-47cd-9bf5-ab3f64533157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.075762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2259956-5974-47cd-9bf5-ab3f64533157 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.116950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1023/2060] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:56 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:57.121710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.123462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.212894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35f2dc-2872-48b7-a3ab-652ae901bb57 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.219802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f783e8-59c9-4e0f-8620-172265872286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.220688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f783e8-59c9-4e0f-8620-172265872286 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.221055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f783e8-59c9-4e0f-8620-172265872286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.221727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f783e8-59c9-4e0f-8620-172265872286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.222867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f783e8-59c9-4e0f-8620-172265872286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.226120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f783e8-59c9-4e0f-8620-172265872286 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.240837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1038/2061] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:57.245073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2259956-5974-47cd-9bf5-ab3f64533157 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.265678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2259956-5974-47cd-9bf5-ab3f64533157 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.275089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b4333-5e7b-4e97-95d3-bd7327b02da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.275750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4333-5e7b-4e97-95d3-bd7327b02da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.276031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4333-5e7b-4e97-95d3-bd7327b02da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.276302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4333-5e7b-4e97-95d3-bd7327b02da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.277526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b4333-5e7b-4e97-95d3-bd7327b02da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.278698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b4333-5e7b-4e97-95d3-bd7327b02da1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.297758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1024/2062] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:57.298318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f783e8-59c9-4e0f-8620-172265872286 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.311430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f783e8-59c9-4e0f-8620-172265872286 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.318607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.319740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.320333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.320535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] PATH_INFO: `/v3/projects/2b1381e2a1734ebfbd6b358132eed7c6/users/3a7f6696b887427db8b7218788b35acf/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.341050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1381e2a1734ebfbd6b358132eed7c6, user_id=3a7f6696b887427db8b7218788b35acf, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.343907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.347791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:57.371463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1039/2063] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:57 2022] PUT /identity/v3/projects/2b1381e2a1734ebfbd6b358132eed7c6/users/3a7f6696b887427db8b7218788b35acf/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:57.388784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afdd6e-2fa0-442b-a5aa-6f7f30c24c6b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.388784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afdd6e-2fa0-442b-a5aa-6f7f30c24c6b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.388784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afdd6e-2fa0-442b-a5aa-6f7f30c24c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.421568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-76afdd6e-2fa0-442b-a5aa-6f7f30c24c6b None None] MFA Rules not processed for user `3a7f6696b887427db8b7218788b35acf`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:57.422871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-76afdd6e-2fa0-442b-a5aa-6f7f30c24c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.530868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.541345 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.546518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1025/2064] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:57.547575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afdd6e-2fa0-442b-a5aa-6f7f30c24c6b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.619814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:57.648953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a51e3-ffc5-4ba9-b383-564a26f203af admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.651613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afdd6e-2fa0-442b-a5aa-6f7f30c24c6b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.653920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.654613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.654903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.655184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] PATH_INFO: `/v3/projects/902d76ebc3ca4039bd62dae5a7431d20` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.656326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902d76ebc3ca4039bd62dae5a7431d20)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.657131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ff81-b184-422e-a7de-b3f57f6c6a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.657742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ff81-b184-422e-a7de-b3f57f6c6a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.658019 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ff81-b184-422e-a7de-b3f57f6c6a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.658335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.658496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ff81-b184-422e-a7de-b3f57f6c6a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.659972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86ff81-b184-422e-a7de-b3f57f6c6a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.661913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86ff81-b184-422e-a7de-b3f57f6c6a99 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.731290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1026/2065] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:57.732168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ff81-b184-422e-a7de-b3f57f6c6a99 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.736175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902d76ebc3ca4039bd62dae5a7431d20', 'request_id': 'req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.743687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902d76ebc3ca4039bd62dae5a7431d20', 'request_id': 'req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.749615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902d76ebc3ca4039bd62dae5a7431d20', 'request_id': 'req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.769005 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] The token cache is being invalidate because project 902d76ebc3ca4039bd62dae5a7431d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:57.769767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.771050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-17b888e0-22b7-4c7d-b26f-6fbb19731dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.773515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1040/2066] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:57 2022] DELETE /identity/v3/projects/902d76ebc3ca4039bd62dae5a7431d20 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:57.782071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08762928-2f98-44b7-bd4c-f9b361a68d71 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.783018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08762928-2f98-44b7-bd4c-f9b361a68d71 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.783533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08762928-2f98-44b7-bd4c-f9b361a68d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.821034 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-08762928-2f98-44b7-bd4c-f9b361a68d71 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:57.822582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ff81-b184-422e-a7de-b3f57f6c6a99 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.822795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-08762928-2f98-44b7-bd4c-f9b361a68d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.829292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.830078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.830551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.831531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.832804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.835848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.844026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1041/2067] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:57.847598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53948e-2d67-4f9c-af5f-c449088d54f9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.847846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53948e-2d67-4f9c-af5f-c449088d54f9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.848046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53948e-2d67-4f9c-af5f-c449088d54f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.867649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1027/2068] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:57.870601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9d53948e-2d67-4f9c-af5f-c449088d54f9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:57.871997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9d53948e-2d67-4f9c-af5f-c449088d54f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.873358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.876327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.886227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1042/2069] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:57.891858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53948e-2d67-4f9c-af5f-c449088d54f9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.899989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd720a0-4b3a-420c-b612-e0d63843ba73 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.905500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114b8ad-f78f-4b84-80e8-e4e31ba4aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.906164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114b8ad-f78f-4b84-80e8-e4e31ba4aeeb admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.906474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114b8ad-f78f-4b84-80e8-e4e31ba4aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.906748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114b8ad-f78f-4b84-80e8-e4e31ba4aeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.907403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114b8ad-f78f-4b84-80e8-e4e31ba4aeeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.909806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114b8ad-f78f-4b84-80e8-e4e31ba4aeeb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.922520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1028/2070] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:57.924222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53948e-2d67-4f9c-af5f-c449088d54f9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.925952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114b8ad-f78f-4b84-80e8-e4e31ba4aeeb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.935158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.936161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.936644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.936748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114b8ad-f78f-4b84-80e8-e4e31ba4aeeb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.937133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.938437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:57.939184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.942551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08569f-edf7-489b-9c5f-994d2e24cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.943239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08569f-edf7-489b-9c5f-994d2e24cbb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.943454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.943596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08569f-edf7-489b-9c5f-994d2e24cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.943897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08569f-edf7-489b-9c5f-994d2e24cbb0 admin admin] PATH_INFO: `/v3/projects/9b62000ac4844446a093db4bf07575d5/users/9b814e3ca7e8442c8419532036d8284f/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.961280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08569f-edf7-489b-9c5f-994d2e24cbb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b62000ac4844446a093db4bf07575d5, user_id=9b814e3ca7e8442c8419532036d8284f, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.964121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08569f-edf7-489b-9c5f-994d2e24cbb0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.978198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1043/2071] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:57.980140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.980254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1029/2072] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:57 2022] PUT /identity/v3/projects/9b62000ac4844446a093db4bf07575d5/users/9b814e3ca7e8442c8419532036d8284f/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:57.984710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08569f-edf7-489b-9c5f-994d2e24cbb0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.999615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddf48-0c15-41ee-84d1-4c284e50b981 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.064327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08569f-edf7-489b-9c5f-994d2e24cbb0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.070314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8fc4a-69e5-4021-8347-9898ac586c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.070989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46626131-9cf5-4b94-8d87-8367ebc52a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.071108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fc4a-69e5-4021-8347-9898ac586c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.071355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fc4a-69e5-4021-8347-9898ac586c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.071608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626131-9cf5-4b94-8d87-8367ebc52a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.071701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8fc4a-69e5-4021-8347-9898ac586c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.071891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626131-9cf5-4b94-8d87-8367ebc52a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.072166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46626131-9cf5-4b94-8d87-8367ebc52a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.072291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8fc4a-69e5-4021-8347-9898ac586c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.072806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46626131-9cf5-4b94-8d87-8367ebc52a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.073991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8fc4a-69e5-4021-8347-9898ac586c56 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.074785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46626131-9cf5-4b94-8d87-8367ebc52a6f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.079832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:58.090229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1030/2073] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:58.091682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8fc4a-69e5-4021-8347-9898ac586c56 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.111104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8fc4a-69e5-4021-8347-9898ac586c56 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.116786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc7f27-aa84-4943-8c22-9a030be04d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.117101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1044/2074] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:58.117469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc7f27-aa84-4943-8c22-9a030be04d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.117803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc7f27-aa84-4943-8c22-9a030be04d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.118080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc7f27-aa84-4943-8c22-9a030be04d96 admin admin] PATH_INFO: `/v3/projects/9b62000ac4844446a093db4bf07575d5/users/9b814e3ca7e8442c8419532036d8284f/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.120161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc7f27-aa84-4943-8c22-9a030be04d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b62000ac4844446a093db4bf07575d5, user_id=9b814e3ca7e8442c8419532036d8284f, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.123060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc7f27-aa84-4943-8c22-9a030be04d96 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.123519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46626131-9cf5-4b94-8d87-8367ebc52a6f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.142309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1031/2075] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:58 2022] PUT /identity/v3/projects/9b62000ac4844446a093db4bf07575d5/users/9b814e3ca7e8442c8419532036d8284f/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:58.163163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c77f8-65a5-4aaa-9e7b-db94ff1cc069 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.163957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c77f8-65a5-4aaa-9e7b-db94ff1cc069 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.164432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c77f8-65a5-4aaa-9e7b-db94ff1cc069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.184146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:58.217428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-189c77f8-65a5-4aaa-9e7b-db94ff1cc069 None None] MFA Rules not processed for user `9b814e3ca7e8442c8419532036d8284f`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:58.220701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-189c77f8-65a5-4aaa-9e7b-db94ff1cc069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.220860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46626131-9cf5-4b94-8d87-8367ebc52a6f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.289656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.290375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.290604 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.290876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.291517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.293446 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.315123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1032/2076] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:58.322564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1045/2077] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:58.323723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c77f8-65a5-4aaa-9e7b-db94ff1cc069 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.334038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.334906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c77f8-65a5-4aaa-9e7b-db94ff1cc069 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.336362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.340118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250731d4-62ff-4d8e-a9cf-831795872cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.340750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250731d4-62ff-4d8e-a9cf-831795872cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.341032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250731d4-62ff-4d8e-a9cf-831795872cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.341310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250731d4-62ff-4d8e-a9cf-831795872cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.341972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250731d4-62ff-4d8e-a9cf-831795872cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.343667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250731d4-62ff-4d8e-a9cf-831795872cd3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.358045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1033/2078] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:58.364088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250731d4-62ff-4d8e-a9cf-831795872cd3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.375013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250731d4-62ff-4d8e-a9cf-831795872cd3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.382495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc914f0a-48c8-4d2c-8749-24fe9b6e2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.383234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc914f0a-48c8-4d2c-8749-24fe9b6e2ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.383574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc914f0a-48c8-4d2c-8749-24fe9b6e2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.383905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc914f0a-48c8-4d2c-8749-24fe9b6e2ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.384658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc914f0a-48c8-4d2c-8749-24fe9b6e2ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.386872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc914f0a-48c8-4d2c-8749-24fe9b6e2ff1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.402462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1034/2079] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:58.403580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc914f0a-48c8-4d2c-8749-24fe9b6e2ff1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.410055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e520844-32f1-4e5a-bfe2-bc4aa1c2bd22 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.414859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc914f0a-48c8-4d2c-8749-24fe9b6e2ff1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.416182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.417221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.417727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.418030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.419659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340b62e-5ae0-46ed-a99f-9a3a2337c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.420335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340b62e-5ae0-46ed-a99f-9a3a2337c311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.420618 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340b62e-5ae0-46ed-a99f-9a3a2337c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.420898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340b62e-5ae0-46ed-a99f-9a3a2337c311 admin admin] PATH_INFO: `/v3/projects/f98f5de3bdd24874a5bdd9b94287e319/users/8a18158a3de64425b859c8f8d4c1baa5/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.421012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.439787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340b62e-5ae0-46ed-a99f-9a3a2337c311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98f5de3bdd24874a5bdd9b94287e319, user_id=8a18158a3de64425b859c8f8d4c1baa5, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.445606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340b62e-5ae0-46ed-a99f-9a3a2337c311 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.488063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1035/2080] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:58 2022] PUT /identity/v3/projects/f98f5de3bdd24874a5bdd9b94287e319/users/8a18158a3de64425b859c8f8d4c1baa5/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:58.490448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6167b-e78e-4c3f-9687-d38bbecacb4f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.490923 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6167b-e78e-4c3f-9687-d38bbecacb4f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.491404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6167b-e78e-4c3f-9687-d38bbecacb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.503572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:58.562624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-dcc6167b-e78e-4c3f-9687-d38bbecacb4f None None] MFA Rules not processed for user `8a18158a3de64425b859c8f8d4c1baa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:58.564591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dcc6167b-e78e-4c3f-9687-d38bbecacb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.585255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.588538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.609668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1046/2081] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:58.669049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1036/2082] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:58.674311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.689791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07748a-bbd7-4e28-b963-cde77e9e9b9e service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.765124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240e3a4-d87d-45af-b664-5efbc09b05e5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.765438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240e3a4-d87d-45af-b664-5efbc09b05e5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.765692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240e3a4-d87d-45af-b664-5efbc09b05e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.815517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacf215-b0f9-469f-a8a2-f3f0f6a68815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.816407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf215-b0f9-469f-a8a2-f3f0f6a68815 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.816701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf215-b0f9-469f-a8a2-f3f0f6a68815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.816979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf215-b0f9-469f-a8a2-f3f0f6a68815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.817677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacf215-b0f9-469f-a8a2-f3f0f6a68815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.819675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacf215-b0f9-469f-a8a2-f3f0f6a68815 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.864884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:58.865192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1047/2083] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:58.869183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacf215-b0f9-469f-a8a2-f3f0f6a68815 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.871035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8240e3a4-d87d-45af-b664-5efbc09b05e5 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:58.873375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8240e3a4-d87d-45af-b664-5efbc09b05e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.984030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacf215-b0f9-469f-a8a2-f3f0f6a68815 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.997376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.998743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.000161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.000865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.005097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1037/2084] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:59.007755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.014277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.131192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240e3a4-d87d-45af-b664-5efbc09b05e5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.132163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1048/2085] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:59.137085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.139220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:59.159439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240e3a4-d87d-45af-b664-5efbc09b05e5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.176154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9de6f-b199-47f7-aa75-37e9096bf73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.177373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9de6f-b199-47f7-aa75-37e9096bf73e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.178074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9de6f-b199-47f7-aa75-37e9096bf73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.178515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9de6f-b199-47f7-aa75-37e9096bf73e admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.179358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9de6f-b199-47f7-aa75-37e9096bf73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.181363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9de6f-b199-47f7-aa75-37e9096bf73e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.217539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1038/2086] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:59.226120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9de6f-b199-47f7-aa75-37e9096bf73e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.247912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9de6f-b199-47f7-aa75-37e9096bf73e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.258461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699ad2-7711-4871-80c3-bc27acdf5ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.259852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699ad2-7711-4871-80c3-bc27acdf5ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.260353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699ad2-7711-4871-80c3-bc27acdf5ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.260835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d699ad2-7711-4871-80c3-bc27acdf5ec7 admin admin] PATH_INFO: `/v3/projects/37e55d0f0f954562a28b2108b29509c0/users/8c40ab958c9e43e9ad4e58f92fc00373/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.278723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:59.302619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d699ad2-7711-4871-80c3-bc27acdf5ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e55d0f0f954562a28b2108b29509c0, user_id=8c40ab958c9e43e9ad4e58f92fc00373, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.305568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d699ad2-7711-4871-80c3-bc27acdf5ec7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.324441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1039/2087] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:59 2022] PUT /identity/v3/projects/37e55d0f0f954562a28b2108b29509c0/users/8c40ab958c9e43e9ad4e58f92fc00373/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:59.330108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699ad2-7711-4871-80c3-bc27acdf5ec7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.338328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89aec89-1ea5-4fe3-9813-2736054e84b5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.420496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d699ad2-7711-4871-80c3-bc27acdf5ec7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.426130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7f577-ca2f-4034-9d30-bc794c0fc0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.426892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f577-ca2f-4034-9d30-bc794c0fc0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.427241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f577-ca2f-4034-9d30-bc794c0fc0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.427591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f577-ca2f-4034-9d30-bc794c0fc0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.428249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7f577-ca2f-4034-9d30-bc794c0fc0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.429858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7f577-ca2f-4034-9d30-bc794c0fc0b5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.443854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a794-59d6-4502-8655-431a13f6118e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.444481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a794-59d6-4502-8655-431a13f6118e service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.444757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a794-59d6-4502-8655-431a13f6118e service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.446375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a794-59d6-4502-8655-431a13f6118e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.447505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1040/2088] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:59.453966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7f577-ca2f-4034-9d30-bc794c0fc0b5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.476545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7f577-ca2f-4034-9d30-bc794c0fc0b5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.481867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcded7a9-dc02-474c-9e7e-d9fc34c2f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.482577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcded7a9-dc02-474c-9e7e-d9fc34c2f112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.482858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcded7a9-dc02-474c-9e7e-d9fc34c2f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.483129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcded7a9-dc02-474c-9e7e-d9fc34c2f112 admin admin] PATH_INFO: `/v3/projects/37e55d0f0f954562a28b2108b29509c0/users/8c40ab958c9e43e9ad4e58f92fc00373/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.485269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcded7a9-dc02-474c-9e7e-d9fc34c2f112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e55d0f0f954562a28b2108b29509c0, user_id=8c40ab958c9e43e9ad4e58f92fc00373, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.488155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcded7a9-dc02-474c-9e7e-d9fc34c2f112 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.503081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1041/2089] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:59 2022] PUT /identity/v3/projects/37e55d0f0f954562a28b2108b29509c0/users/8c40ab958c9e43e9ad4e58f92fc00373/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:59.516615 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846475-fac1-4a4f-b1a2-7666dd36b826 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.517041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846475-fac1-4a4f-b1a2-7666dd36b826 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.517422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b846475-fac1-4a4f-b1a2-7666dd36b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.545553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a794-59d6-4502-8655-431a13f6118e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.548513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a794-59d6-4502-8655-431a13f6118e service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.551442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0b846475-fac1-4a4f-b1a2-7666dd36b826 None None] MFA Rules not processed for user `8c40ab958c9e43e9ad4e58f92fc00373`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:59.552934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0b846475-fac1-4a4f-b1a2-7666dd36b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:59.562149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1049/2090] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:16:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 08:16:59.626606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:59.699800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1042/2091] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:16:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:59.721807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a794-59d6-4502-8655-431a13f6118e service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.803789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a794-59d6-4502-8655-431a13f6118e service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.852548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:59.868553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ad820-2ea8-41da-870d-e0973a3e9d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.869197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ad820-2ea8-41da-870d-e0973a3e9d76 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.869486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ad820-2ea8-41da-870d-e0973a3e9d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.869769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ad820-2ea8-41da-870d-e0973a3e9d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.892320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ad820-2ea8-41da-870d-e0973a3e9d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.905130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ad820-2ea8-41da-870d-e0973a3e9d76 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.917518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1050/2092] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:00.359209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b846475-fac1-4a4f-b1a2-7666dd36b826 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:00.360734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0b846475-fac1-4a4f-b1a2-7666dd36b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:00.411164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b846475-fac1-4a4f-b1a2-7666dd36b826 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:00.423748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acee02e-a874-4cc8-aa18-1679bd855a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:00.424516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee02e-a874-4cc8-aa18-1679bd855a9a service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:00.424947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee02e-a874-4cc8-aa18-1679bd855a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:00.425443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee02e-a874-4cc8-aa18-1679bd855a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.431917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4acee02e-a874-4cc8-aa18-1679bd855a9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:00.539458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acee02e-a874-4cc8-aa18-1679bd855a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:00.540922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acee02e-a874-4cc8-aa18-1679bd855a9a service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:00.552139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1043/2093] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:00.885778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ad820-2ea8-41da-870d-e0973a3e9d76 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:00.956604 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ad820-2ea8-41da-870d-e0973a3e9d76 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:00.961915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:00.962670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:00.962957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:00.963261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] PATH_INFO: `/v3/users/8a18158a3de64425b859c8f8d4c1baa5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.964418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a18158a3de64425b859c8f8d4c1baa5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:00.966380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:01.026687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a18158a3de64425b859c8f8d4c1baa5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.041178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a18158a3de64425b859c8f8d4c1baa5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.042322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a18158a3de64425b859c8f8d4c1baa5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.053621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a18158a3de64425b859c8f8d4c1baa5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.054186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a18158a3de64425b859c8f8d4c1baa5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.080861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1051/2094] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:00 2022] DELETE /identity/v3/users/8a18158a3de64425b859c8f8d4c1baa5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:01.090311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67a169-d4ae-4dd8-8c0e-2acc2e6dfacf None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:01.090975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67a169-d4ae-4dd8-8c0e-2acc2e6dfacf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:01.091645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67a169-d4ae-4dd8-8c0e-2acc2e6dfacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:01.129072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-da67a169-d4ae-4dd8-8c0e-2acc2e6dfacf None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:01.131480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-da67a169-d4ae-4dd8-8c0e-2acc2e6dfacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:01.246024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1044/2095] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:01.258449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:01.259904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:01.330314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca52cc8-fb59-40d7-96b2-d427e7776eff admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:01.334893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:01.335527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:01.335856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:01.336146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:01.348209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:01.350861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:01.352508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:01.357958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67a169-d4ae-4dd8-8c0e-2acc2e6dfacf None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:01.359536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-da67a169-d4ae-4dd8-8c0e-2acc2e6dfacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:01.366864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1052/2096] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:01.435879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67a169-d4ae-4dd8-8c0e-2acc2e6dfacf None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:01.455037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:01.457860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:01.458768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:01.459557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:01.463607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:01.539192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:01.606170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:01.607763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:01.618459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1045/2097] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:17:01.812582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:01.814954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:01.833335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ac74d-3a29-41f0-a948-68ac81e09a4e service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:01.840074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:01.840863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:01.841169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:01.841450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] PATH_INFO: `/v3/projects/f98f5de3bdd24874a5bdd9b94287e319` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:01.842861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98f5de3bdd24874a5bdd9b94287e319)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:01.845084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:01.913239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98f5de3bdd24874a5bdd9b94287e319', 'request_id': 'req-9a77807b-584e-431a-a1fa-a711ac7e6d98'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.920281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98f5de3bdd24874a5bdd9b94287e319', 'request_id': 'req-9a77807b-584e-431a-a1fa-a711ac7e6d98'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.926471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98f5de3bdd24874a5bdd9b94287e319', 'request_id': 'req-9a77807b-584e-431a-a1fa-a711ac7e6d98'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.940714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] The token cache is being invalidate because project f98f5de3bdd24874a5bdd9b94287e319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:01.942897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.944038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:01.946880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1053/2098] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:01 2022] DELETE /identity/v3/projects/f98f5de3bdd24874a5bdd9b94287e319 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:01.950944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:01.965034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed774f4-f8c0-4a42-b1bb-45e062e8d946 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:02.033311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:02.034100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.034411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.034688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] PATH_INFO: `/v3/users/8c40ab958c9e43e9ad4e58f92fc00373` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.035825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c40ab958c9e43e9ad4e58f92fc00373)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:02.037753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:02.086134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c40ab958c9e43e9ad4e58f92fc00373'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.093051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c40ab958c9e43e9ad4e58f92fc00373'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.093737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c40ab958c9e43e9ad4e58f92fc00373'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.101429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c40ab958c9e43e9ad4e58f92fc00373'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.114480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c40ab958c9e43e9ad4e58f92fc00373'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.120414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1046/2099] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:01 2022] DELETE /identity/v3/users/8c40ab958c9e43e9ad4e58f92fc00373 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:02.289439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:02.300219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:02.319396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77807b-584e-431a-a1fa-a711ac7e6d98 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:02.386941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:02.387727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.388186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.388472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] PATH_INFO: `/v3/users/435831336d4041768c5d4733fca4009f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.389819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435831336d4041768c5d4733fca4009f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:02.391834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:02.450753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435831336d4041768c5d4733fca4009f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.460984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:02.462986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:02.485926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435831336d4041768c5d4733fca4009f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.487563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435831336d4041768c5d4733fca4009f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.496456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a9d27-e9cc-45e7-9093-3b6b55028d40 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:02.499702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435831336d4041768c5d4733fca4009f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.500945 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4758e2ad-8cec-48c3-8b8e-10bdfb84a5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435831336d4041768c5d4733fca4009f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.506766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:02.507541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.508190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.508524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] PATH_INFO: `/v3/projects/37e55d0f0f954562a28b2108b29509c0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.509978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e55d0f0f954562a28b2108b29509c0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:02.512218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:02.529465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:02.537361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1054/2100] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:02 2022] DELETE /identity/v3/users/435831336d4041768c5d4733fca4009f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:02.543293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4350-de0e-4fd2-9fd7-9ea70275b80b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.544238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4350-de0e-4fd2-9fd7-9ea70275b80b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.546139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4350-de0e-4fd2-9fd7-9ea70275b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.578796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:02.583227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3c5d4350-de0e-4fd2-9fd7-9ea70275b80b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:02.584490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3c5d4350-de0e-4fd2-9fd7-9ea70275b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:02.596839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e55d0f0f954562a28b2108b29509c0', 'request_id': 'req-a1da9676-9417-45bd-958e-4246994ee421'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.610227 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e55d0f0f954562a28b2108b29509c0', 'request_id': 'req-a1da9676-9417-45bd-958e-4246994ee421'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.625631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e55d0f0f954562a28b2108b29509c0', 'request_id': 'req-a1da9676-9417-45bd-958e-4246994ee421'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.649077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] The token cache is being invalidate because project 37e55d0f0f954562a28b2108b29509c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:02.649695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.650461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1da9676-9417-45bd-958e-4246994ee421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:02.652565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1047/2101] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:02 2022] DELETE /identity/v3/projects/37e55d0f0f954562a28b2108b29509c0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:02.657390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a724-5c9e-4e2e-b84d-d0b0a6cdaf88 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.657792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a724-5c9e-4e2e-b84d-d0b0a6cdaf88 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.657889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a724-5c9e-4e2e-b84d-d0b0a6cdaf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.687490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1055/2102] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:02.692822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fa53a724-5c9e-4e2e-b84d-d0b0a6cdaf88 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:02.695072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fa53a724-5c9e-4e2e-b84d-d0b0a6cdaf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:02.699586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d4350-de0e-4fd2-9fd7-9ea70275b80b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:02.704180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3c5d4350-de0e-4fd2-9fd7-9ea70275b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:02.717991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1048/2103] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:02.720893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391c257-f4e0-42a0-924a-bfc991f7a7bf None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.722138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391c257-f4e0-42a0-924a-bfc991f7a7bf None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.723543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391c257-f4e0-42a0-924a-bfc991f7a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.764001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0391c257-f4e0-42a0-924a-bfc991f7a7bf None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:02.765977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0391c257-f4e0-42a0-924a-bfc991f7a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:02.778428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1049/2104] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:02.783050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391c257-f4e0-42a0-924a-bfc991f7a7bf None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:02.800193 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391c257-f4e0-42a0-924a-bfc991f7a7bf None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:02.805873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:02.806969 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.806969 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.807184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.807813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:17:02.808250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:02.810348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:02.811336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d4350-de0e-4fd2-9fd7-9ea70275b80b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:02.817217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c0bf-a883-4a32-bf7f-4be792747b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:02.818010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c0bf-a883-4a32-bf7f-4be792747b67 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.818400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c0bf-a883-4a32-bf7f-4be792747b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.818754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c0bf-a883-4a32-bf7f-4be792747b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.826052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1050/2105] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:17:02.831729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:02.835776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c0bf-a883-4a32-bf7f-4be792747b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:02.837925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c0bf-a883-4a32-bf7f-4be792747b67 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:02.852776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6284184-0192-40fc-88b0-cfae3aa186bc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:02.857151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1056/2106] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:17:02.861807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3a6f-5290-428f-8152-a593c960af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:02.863321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3a6f-5290-428f-8152-a593c960af51 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.864179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3a6f-5290-428f-8152-a593c960af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.864713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3a6f-5290-428f-8152-a593c960af51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.865703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f3a6f-5290-428f-8152-a593c960af51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:02.868031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f3a6f-5290-428f-8152-a593c960af51 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:02.926755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1051/2107] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:17:02 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:02.931627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c0bf-a883-4a32-bf7f-4be792747b67 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:02.975010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c0bf-a883-4a32-bf7f-4be792747b67 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.096989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c25f2-b609-4440-b7fd-c6c2aeecd0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.105750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c25f2-b609-4440-b7fd-c6c2aeecd0bc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.106453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c25f2-b609-4440-b7fd-c6c2aeecd0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.107078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c25f2-b609-4440-b7fd-c6c2aeecd0bc admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.107932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c25f2-b609-4440-b7fd-c6c2aeecd0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.110118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c25f2-b609-4440-b7fd-c6c2aeecd0bc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.139221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1057/2108] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:17:02 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:17:03.145456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3a6f-5290-428f-8152-a593c960af51 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.158244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3a6f-5290-428f-8152-a593c960af51 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.164833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6c129-bd8b-458b-97f9-a8c40b3eaf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.165656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6c129-bd8b-458b-97f9-a8c40b3eaf74 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.165948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6c129-bd8b-458b-97f9-a8c40b3eaf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.166377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6c129-bd8b-458b-97f9-a8c40b3eaf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.167344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6c129-bd8b-458b-97f9-a8c40b3eaf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.169186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6c129-bd8b-458b-97f9-a8c40b3eaf74 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.185662 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1052/2109] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:17:03.188105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c25f2-b609-4440-b7fd-c6c2aeecd0bc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.213798 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c25f2-b609-4440-b7fd-c6c2aeecd0bc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.232470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.234084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.234478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.234833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.236242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.239686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.258086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1058/2110] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:03.271762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6c129-bd8b-458b-97f9-a8c40b3eaf74 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.283179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6c129-bd8b-458b-97f9-a8c40b3eaf74 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.289444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31671b13-db1e-42c7-9010-eab0cf00633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.290199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31671b13-db1e-42c7-9010-eab0cf00633a admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.290533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31671b13-db1e-42c7-9010-eab0cf00633a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.290777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31671b13-db1e-42c7-9010-eab0cf00633a admin admin] PATH_INFO: `/v3/projects/7d9d474f53ff4277929c05a25a7e171a/users/5d5c4f98fa9344238a5dca98c6bc89d6/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.300737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.304486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:03.313603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31671b13-db1e-42c7-9010-eab0cf00633a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9d474f53ff4277929c05a25a7e171a, user_id=5d5c4f98fa9344238a5dca98c6bc89d6, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.317176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31671b13-db1e-42c7-9010-eab0cf00633a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.325664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43834a34-d48b-4ce8-af1e-51b4130c9587 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.334168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1053/2111] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:03 2022] PUT /identity/v3/projects/7d9d474f53ff4277929c05a25a7e171a/users/5d5c4f98fa9344238a5dca98c6bc89d6/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:03.341532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.342188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.342496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.342810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] PATH_INFO: `/v3/projects/3f0cc9b39b254c2f9427fe3932b0e8a1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.343947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0cc9b39b254c2f9427fe3932b0e8a1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.345508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70454ef6-2aa9-457f-a16b-9a16ac67de32 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.345803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70454ef6-2aa9-457f-a16b-9a16ac67de32 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.345974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.346414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70454ef6-2aa9-457f-a16b-9a16ac67de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.371163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:03.382146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-70454ef6-2aa9-457f-a16b-9a16ac67de32 None None] MFA Rules not processed for user `5d5c4f98fa9344238a5dca98c6bc89d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:03.387485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-70454ef6-2aa9-457f-a16b-9a16ac67de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:03.416610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0cc9b39b254c2f9427fe3932b0e8a1', 'request_id': 'req-cfab397f-11cf-42e4-be35-c8941239d939'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.426776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0cc9b39b254c2f9427fe3932b0e8a1', 'request_id': 'req-cfab397f-11cf-42e4-be35-c8941239d939'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.433879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0cc9b39b254c2f9427fe3932b0e8a1', 'request_id': 'req-cfab397f-11cf-42e4-be35-c8941239d939'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.464712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] The token cache is being invalidate because project 3f0cc9b39b254c2f9427fe3932b0e8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:03.465266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.466793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cfab397f-11cf-42e4-be35-c8941239d939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.469905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1059/2112] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:03 2022] DELETE /identity/v3/projects/3f0cc9b39b254c2f9427fe3932b0e8a1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:03.479072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3677d-3a55-46d3-8bab-abed7f9e1083 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.479570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3677d-3a55-46d3-8bab-abed7f9e1083 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.480233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3677d-3a55-46d3-8bab-abed7f9e1083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.510904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2ac3677d-3a55-46d3-8bab-abed7f9e1083 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:03.512347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ac3677d-3a55-46d3-8bab-abed7f9e1083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:03.519678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1054/2113] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:03.524074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70454ef6-2aa9-457f-a16b-9a16ac67de32 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.525467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-70454ef6-2aa9-457f-a16b-9a16ac67de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:03.565666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:03.579631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1060/2114] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:03.589381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0fd9d-4f81-4874-8d34-0713abce9efc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.589670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0fd9d-4f81-4874-8d34-0713abce9efc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.589871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0fd9d-4f81-4874-8d34-0713abce9efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.610708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70454ef6-2aa9-457f-a16b-9a16ac67de32 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.617435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-29c0fd9d-4f81-4874-8d34-0713abce9efc None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:03.618894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4a511-454f-43e5-8698-026f9a1b8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.619406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-29c0fd9d-4f81-4874-8d34-0713abce9efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:03.619932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4a511-454f-43e5-8698-026f9a1b8095 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.620395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4a511-454f-43e5-8698-026f9a1b8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.620899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4a511-454f-43e5-8698-026f9a1b8095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.621995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4a511-454f-43e5-8698-026f9a1b8095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.625741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4a511-454f-43e5-8698-026f9a1b8095 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.633137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1061/2115] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:03.638154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0fd9d-4f81-4874-8d34-0713abce9efc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.651767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0fd9d-4f81-4874-8d34-0713abce9efc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.657797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.658465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.660424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.661298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.661424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1055/2116] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:17:03 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:17:03.666318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:17:03.666924 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.667688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4a511-454f-43e5-8698-026f9a1b8095 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.669325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.697030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1062/2117] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:17:03.706901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.719474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04eb5c-b795-4166-90bd-7dac1a3ac075 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.764391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4a511-454f-43e5-8698-026f9a1b8095 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.770506 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbba61-1798-4248-910c-c301c7a16db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.771128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbba61-1798-4248-910c-c301c7a16db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.771404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbba61-1798-4248-910c-c301c7a16db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.771677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbba61-1798-4248-910c-c301c7a16db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.772326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbba61-1798-4248-910c-c301c7a16db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.774406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbba61-1798-4248-910c-c301c7a16db5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.783500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fea1f-d7c5-4786-8bd4-818228d3a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.784870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fea1f-d7c5-4786-8bd4-818228d3a904 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.785182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fea1f-d7c5-4786-8bd4-818228d3a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.785401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fea1f-d7c5-4786-8bd4-818228d3a904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.786063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fea1f-d7c5-4786-8bd4-818228d3a904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.788044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fea1f-d7c5-4786-8bd4-818228d3a904 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.805419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1056/2118] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:17:03 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:17:03.807832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbba61-1798-4248-910c-c301c7a16db5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.820324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbba61-1798-4248-910c-c301c7a16db5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.827424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1063/2119] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:17:03 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:17:03.829286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fea1f-d7c5-4786-8bd4-818228d3a904 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.845137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:03.941635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a5069-2c8b-4cef-a8b0-25cba42c643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.942549 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a5069-2c8b-4cef-a8b0-25cba42c643e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.942839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a5069-2c8b-4cef-a8b0-25cba42c643e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.943211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a5069-2c8b-4cef-a8b0-25cba42c643e admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.943897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a5069-2c8b-4cef-a8b0-25cba42c643e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.945554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a5069-2c8b-4cef-a8b0-25cba42c643e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.950900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fea1f-d7c5-4786-8bd4-818228d3a904 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.957419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1057/2120] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:17:03.959056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1921-670e-4fea-95e2-4836349c539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.961537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1921-670e-4fea-95e2-4836349c539a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.961537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1921-670e-4fea-95e2-4836349c539a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.961537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1921-670e-4fea-95e2-4836349c539a admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.961537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c1921-670e-4fea-95e2-4836349c539a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.962290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a5069-2c8b-4cef-a8b0-25cba42c643e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.975313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a5069-2c8b-4cef-a8b0-25cba42c643e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.975476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c1921-670e-4fea-95e2-4836349c539a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.980692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec5ee0-7700-4095-87be-c0e5a8d3b3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.981564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5ee0-7700-4095-87be-c0e5a8d3b3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.982020 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5ee0-7700-4095-87be-c0e5a8d3b3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.982492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5ee0-7700-4095-87be-c0e5a8d3b3e2 admin admin] PATH_INFO: `/v3/projects/5a6f0c8b594e44d5bdc7c67a16c0edc0/users/d0cae5fcc6234867931fec197d8e59b7/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.004879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec5ee0-7700-4095-87be-c0e5a8d3b3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6f0c8b594e44d5bdc7c67a16c0edc0, user_id=d0cae5fcc6234867931fec197d8e59b7, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.005497 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1064/2121] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:17:03 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:04.022096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1921-670e-4fea-95e2-4836349c539a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.022589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec5ee0-7700-4095-87be-c0e5a8d3b3e2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.022722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1921-670e-4fea-95e2-4836349c539a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.028566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1058/2122] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:03 2022] PUT /identity/v3/projects/5a6f0c8b594e44d5bdc7c67a16c0edc0/users/d0cae5fcc6234867931fec197d8e59b7/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:04.032113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec5ee0-7700-4095-87be-c0e5a8d3b3e2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.060113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:04.102284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce4b2f-0248-4880-a97b-5219507e48d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.103259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4b2f-0248-4880-a97b-5219507e48d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.103874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4b2f-0248-4880-a97b-5219507e48d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.104192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4b2f-0248-4880-a97b-5219507e48d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.105680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce4b2f-0248-4880-a97b-5219507e48d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.108016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce4b2f-0248-4880-a97b-5219507e48d6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.108518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec5ee0-7700-4095-87be-c0e5a8d3b3e2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.113784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a7173-be7a-4cb7-ae9d-176dcaad7278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.114697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7173-be7a-4cb7-ae9d-176dcaad7278 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.114981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7173-be7a-4cb7-ae9d-176dcaad7278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.115602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7173-be7a-4cb7-ae9d-176dcaad7278 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.115948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a7173-be7a-4cb7-ae9d-176dcaad7278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.117610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a7173-be7a-4cb7-ae9d-176dcaad7278 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.121845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1065/2123] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:04.127839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce4b2f-0248-4880-a97b-5219507e48d6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.132185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1059/2124] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:17:04.137236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a7173-be7a-4cb7-ae9d-176dcaad7278 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.138728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce4b2f-0248-4880-a97b-5219507e48d6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.143981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5416-b31e-49a7-98be-63e33d103090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.144789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5416-b31e-49a7-98be-63e33d103090 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.145076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5416-b31e-49a7-98be-63e33d103090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.145502 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5416-b31e-49a7-98be-63e33d103090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.146157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e5416-b31e-49a7-98be-63e33d103090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.147936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e5416-b31e-49a7-98be-63e33d103090 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.156605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a7173-be7a-4cb7-ae9d-176dcaad7278 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.162142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1066/2125] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:17:04.167440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5416-b31e-49a7-98be-63e33d103090 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.169825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e67264-4f85-4740-80a3-4fe0c411ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.172717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67264-4f85-4740-80a3-4fe0c411ab37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.173218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67264-4f85-4740-80a3-4fe0c411ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.173710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67264-4f85-4740-80a3-4fe0c411ab37 admin admin] PATH_INFO: `/v3/projects/5a6f0c8b594e44d5bdc7c67a16c0edc0/users/d0cae5fcc6234867931fec197d8e59b7/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.177429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e67264-4f85-4740-80a3-4fe0c411ab37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6f0c8b594e44d5bdc7c67a16c0edc0, user_id=d0cae5fcc6234867931fec197d8e59b7, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.181906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5416-b31e-49a7-98be-63e33d103090 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.182979 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e67264-4f85-4740-80a3-4fe0c411ab37 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.187472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17fb75-0619-408f-b065-171aa5357227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.188262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17fb75-0619-408f-b065-171aa5357227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.188593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17fb75-0619-408f-b065-171aa5357227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.188873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17fb75-0619-408f-b065-171aa5357227 admin admin] PATH_INFO: `/v3/projects/f5a46d86f06040cfa9478aa0e9cf0d84/users/eab61350d5174947a9df267a5bdf19f1/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.203417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1060/2126] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:04 2022] PUT /identity/v3/projects/5a6f0c8b594e44d5bdc7c67a16c0edc0/users/d0cae5fcc6234867931fec197d8e59b7/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:04.205057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17fb75-0619-408f-b065-171aa5357227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a46d86f06040cfa9478aa0e9cf0d84, user_id=eab61350d5174947a9df267a5bdf19f1, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.208673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17fb75-0619-408f-b065-171aa5357227 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.223957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b880de-4909-4412-a6b5-4eaad27dec1b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.224416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b880de-4909-4412-a6b5-4eaad27dec1b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.224865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b880de-4909-4412-a6b5-4eaad27dec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.227127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1067/2127] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:04 2022] PUT /identity/v3/projects/f5a46d86f06040cfa9478aa0e9cf0d84/users/eab61350d5174947a9df267a5bdf19f1/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:04.246197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122cb49-a1c8-4d3c-8f52-3a5a063328c5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.246849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122cb49-a1c8-4d3c-8f52-3a5a063328c5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.247439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122cb49-a1c8-4d3c-8f52-3a5a063328c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.274861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d8b880de-4909-4412-a6b5-4eaad27dec1b None None] MFA Rules not processed for user `d0cae5fcc6234867931fec197d8e59b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:04.277044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d8b880de-4909-4412-a6b5-4eaad27dec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:04.286815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4122cb49-a1c8-4d3c-8f52-3a5a063328c5 None None] MFA Rules not processed for user `eab61350d5174947a9df267a5bdf19f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:04.291013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4122cb49-a1c8-4d3c-8f52-3a5a063328c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:04.377202 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:04.414489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1068/2128] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:04.420886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1061/2129] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:04.427244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122cb49-a1c8-4d3c-8f52-3a5a063328c5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.428565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4122cb49-a1c8-4d3c-8f52-3a5a063328c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:04.435527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b880de-4909-4412-a6b5-4eaad27dec1b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.437288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d8b880de-4909-4412-a6b5-4eaad27dec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:04.512720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122cb49-a1c8-4d3c-8f52-3a5a063328c5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.516575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c8019-92d7-4620-8454-1a988d674181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.517195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8019-92d7-4620-8454-1a988d674181 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.517477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8019-92d7-4620-8454-1a988d674181 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.517752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c8019-92d7-4620-8454-1a988d674181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.521960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b880de-4909-4412-a6b5-4eaad27dec1b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.526132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ec883-7db6-4dd3-8525-5cf5985c3791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.526795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ec883-7db6-4dd3-8525-5cf5985c3791 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.527079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ec883-7db6-4dd3-8525-5cf5985c3791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.527355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ec883-7db6-4dd3-8525-5cf5985c3791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.530342 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c8019-92d7-4620-8454-1a988d674181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.533154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c8019-92d7-4620-8454-1a988d674181 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.540016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ec883-7db6-4dd3-8525-5cf5985c3791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.541495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ec883-7db6-4dd3-8525-5cf5985c3791 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.553940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1069/2130] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:04.554186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1062/2131] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:17:05.361026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c8019-92d7-4620-8454-1a988d674181 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:05.433580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c8019-92d7-4620-8454-1a988d674181 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:05.444186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:05.445057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:05.445352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:05.445673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] PATH_INFO: `/v3/users/5d5c4f98fa9344238a5dca98c6bc89d6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:05.447179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5c4f98fa9344238a5dca98c6bc89d6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:05.449155 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:05.503704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5c4f98fa9344238a5dca98c6bc89d6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:05.511555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5c4f98fa9344238a5dca98c6bc89d6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:05.512220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5c4f98fa9344238a5dca98c6bc89d6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:05.520047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5c4f98fa9344238a5dca98c6bc89d6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:05.520974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5c4f98fa9344238a5dca98c6bc89d6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:05.540194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1070/2132] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:05 2022] DELETE /identity/v3/users/5d5c4f98fa9344238a5dca98c6bc89d6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:05.544681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd40c-78c8-4dec-84d0-18bb3bbaa478 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:05.545163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd40c-78c8-4dec-84d0-18bb3bbaa478 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:05.545260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd40c-78c8-4dec-84d0-18bb3bbaa478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:05.565062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8f4dd40c-78c8-4dec-84d0-18bb3bbaa478 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:05.566296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8f4dd40c-78c8-4dec-84d0-18bb3bbaa478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:05.595705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:05.633371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1063/2133] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:05.643581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:05.645066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:05.660092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:05.714875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca73a32-50da-4e8e-8623-1a20b9bc1d8a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:05.718573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0648-e164-4994-8d6f-125da810a715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:05.719190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0648-e164-4994-8d6f-125da810a715 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:05.719474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0648-e164-4994-8d6f-125da810a715 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:05.719752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0648-e164-4994-8d6f-125da810a715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:05.730337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b0648-e164-4994-8d6f-125da810a715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:05.731893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b0648-e164-4994-8d6f-125da810a715 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:05.742108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1071/2134] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:06.063519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dd40c-78c8-4dec-84d0-18bb3bbaa478 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:06.065156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8f4dd40c-78c8-4dec-84d0-18bb3bbaa478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:06.078812 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dd40c-78c8-4dec-84d0-18bb3bbaa478 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:06.084182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:06.084845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:06.085128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:06.085407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] PATH_INFO: `/v3/projects/7d9d474f53ff4277929c05a25a7e171a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:06.086630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9d474f53ff4277929c05a25a7e171a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:06.088555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:06.161669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9d474f53ff4277929c05a25a7e171a', 'request_id': 'req-f586c466-82f6-4d83-9af7-ee32a65cf7dd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.170219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9d474f53ff4277929c05a25a7e171a', 'request_id': 'req-f586c466-82f6-4d83-9af7-ee32a65cf7dd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.216504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9d474f53ff4277929c05a25a7e171a', 'request_id': 'req-f586c466-82f6-4d83-9af7-ee32a65cf7dd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.250908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] The token cache is being invalidate because project 7d9d474f53ff4277929c05a25a7e171a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:06.251212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.251923 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.254924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1064/2135] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:06 2022] DELETE /identity/v3/projects/7d9d474f53ff4277929c05a25a7e171a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:06.259146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0648-e164-4994-8d6f-125da810a715 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:06.290853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0648-e164-4994-8d6f-125da810a715 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:06.301512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:06.303454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:06.394658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:06.395310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:06.395597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:06.395874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] PATH_INFO: `/v3/users/d0cae5fcc6234867931fec197d8e59b7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:06.397240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0cae5fcc6234867931fec197d8e59b7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:06.399322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:06.425701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586c466-82f6-4d83-9af7-ee32a65cf7dd admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:06.430915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:06.431599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:06.431881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:06.432155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] PATH_INFO: `/v3/users/9f1563d6881b4adeaf10a354da3ccb60` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:06.433424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1563d6881b4adeaf10a354da3ccb60)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:06.436548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:06.500849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0cae5fcc6234867931fec197d8e59b7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.533796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1563d6881b4adeaf10a354da3ccb60'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.536449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0cae5fcc6234867931fec197d8e59b7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.541989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0cae5fcc6234867931fec197d8e59b7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.544766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1563d6881b4adeaf10a354da3ccb60'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.545760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1563d6881b4adeaf10a354da3ccb60'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.548606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:06.556123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0cae5fcc6234867931fec197d8e59b7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.558310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0127f91f-0fc5-49b9-bf95-89b2e57d2bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0cae5fcc6234867931fec197d8e59b7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.559940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1563d6881b4adeaf10a354da3ccb60'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.594001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1563d6881b4adeaf10a354da3ccb60'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:06.594822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1072/2136] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:06 2022] DELETE /identity/v3/users/d0cae5fcc6234867931fec197d8e59b7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:06.607373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1065/2137] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:06 2022] DELETE /identity/v3/users/9f1563d6881b4adeaf10a354da3ccb60 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:06.612285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b71000-3c60-4825-a9fe-d6a645ed2d90 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:06.612869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b71000-3c60-4825-a9fe-d6a645ed2d90 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:06.612869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b71000-3c60-4825-a9fe-d6a645ed2d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:06.647193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-15b71000-3c60-4825-a9fe-d6a645ed2d90 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:06.648795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-15b71000-3c60-4825-a9fe-d6a645ed2d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:06.688978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:06.723663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1073/2138] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:06.733482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:06.734972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:06.826440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599410b9-104e-442f-9e7a-5d39789e6488 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:06.830119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e17d0-b546-4839-bdd5-62c2079e22a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:06.830981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e17d0-b546-4839-bdd5-62c2079e22a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:06.831440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e17d0-b546-4839-bdd5-62c2079e22a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:06.831787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e17d0-b546-4839-bdd5-62c2079e22a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:06.842881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e17d0-b546-4839-bdd5-62c2079e22a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:06.844341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e17d0-b546-4839-bdd5-62c2079e22a5 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:06.859392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1066/2139] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:06.995651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b71000-3c60-4825-a9fe-d6a645ed2d90 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:06.997460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-15b71000-3c60-4825-a9fe-d6a645ed2d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.010051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b71000-3c60-4825-a9fe-d6a645ed2d90 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.018286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.018286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.018286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.018286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] PATH_INFO: `/v3/projects/5a6f0c8b594e44d5bdc7c67a16c0edc0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.020420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6f0c8b594e44d5bdc7c67a16c0edc0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.022743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.078511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6f0c8b594e44d5bdc7c67a16c0edc0', 'request_id': 'req-d28288c6-6d04-45aa-940d-00b773944990'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.086103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6f0c8b594e44d5bdc7c67a16c0edc0', 'request_id': 'req-d28288c6-6d04-45aa-940d-00b773944990'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.093800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6f0c8b594e44d5bdc7c67a16c0edc0', 'request_id': 'req-d28288c6-6d04-45aa-940d-00b773944990'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.109566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] The token cache is being invalidate because project 5a6f0c8b594e44d5bdc7c67a16c0edc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:07.109836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.110594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d28288c6-6d04-45aa-940d-00b773944990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.113003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1074/2140] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:06 2022] DELETE /identity/v3/projects/5a6f0c8b594e44d5bdc7c67a16c0edc0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:07.118118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199dfd4-2564-45e9-aee7-eb8b93d57b31 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.118453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199dfd4-2564-45e9-aee7-eb8b93d57b31 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.118742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199dfd4-2564-45e9-aee7-eb8b93d57b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.144250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4199dfd4-2564-45e9-aee7-eb8b93d57b31 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:07.145686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4199dfd4-2564-45e9-aee7-eb8b93d57b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.231004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1067/2141] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:07.233261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e943f7-be0a-4331-846a-280ea5379203 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.233700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e943f7-be0a-4331-846a-280ea5379203 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.233987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e943f7-be0a-4331-846a-280ea5379203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.243405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199dfd4-2564-45e9-aee7-eb8b93d57b31 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.245948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4199dfd4-2564-45e9-aee7-eb8b93d57b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.256893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-28e943f7-be0a-4331-846a-280ea5379203 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:07.258125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-28e943f7-be0a-4331-846a-280ea5379203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.266315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1075/2142] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:07.270834 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e943f7-be0a-4331-846a-280ea5379203 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.277810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199dfd4-2564-45e9-aee7-eb8b93d57b31 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.284317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.285234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e943f7-be0a-4331-846a-280ea5379203 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.285725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.286142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.286583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] PATH_INFO: `/v3/projects/13a0df064509401aaaed3762a9495eb8` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.288227 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a0df064509401aaaed3762a9495eb8)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.290141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.290655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.291517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.291991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.292487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.293449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:17:07.293638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.295424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.315000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1076/2143] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:17:07.316186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.327631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a5eb-f1a2-4f11-89cb-0dacf426dc9a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.334209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bf2b3-4940-481d-b978-9ada40c18700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.335035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bf2b3-4940-481d-b978-9ada40c18700 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.335390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bf2b3-4940-481d-b978-9ada40c18700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.335763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bf2b3-4940-481d-b978-9ada40c18700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.336415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bf2b3-4940-481d-b978-9ada40c18700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.338765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bf2b3-4940-481d-b978-9ada40c18700 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.373962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a0df064509401aaaed3762a9495eb8', 'request_id': 'req-5175fd71-4f23-4fb0-b026-788817bf26a3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.377179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1077/2144] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:17:07 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:07.381306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a0df064509401aaaed3762a9495eb8', 'request_id': 'req-5175fd71-4f23-4fb0-b026-788817bf26a3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.381454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bf2b3-4940-481d-b978-9ada40c18700 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.397626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a0df064509401aaaed3762a9495eb8', 'request_id': 'req-5175fd71-4f23-4fb0-b026-788817bf26a3'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.408222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:07.418373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] The token cache is being invalidate because project 13a0df064509401aaaed3762a9495eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:07.420130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.422541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.429581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1068/2145] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:07 2022] DELETE /identity/v3/projects/13a0df064509401aaaed3762a9495eb8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:07.430939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.433077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.467550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bf2b3-4940-481d-b978-9ada40c18700 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.483650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.484175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.484465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.484749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.485730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.489184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.515721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1078/2146] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:17:07 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:17:07.531807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.533168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175fd71-4f23-4fb0-b026-788817bf26a3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.534919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.541913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.543062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.543876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.543876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] PATH_INFO: `/v3/users/3a7f6696b887427db8b7218788b35acf` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.544608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:07.545692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7f6696b887427db8b7218788b35acf)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.549058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.551338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8e19d-ba4d-46ba-9dfa-640f7e0d4ad7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.558795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217541-151c-4962-b8b0-1a6dd81090f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.559507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217541-151c-4962-b8b0-1a6dd81090f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.559879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217541-151c-4962-b8b0-1a6dd81090f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.560283 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217541-151c-4962-b8b0-1a6dd81090f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.561316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7217541-151c-4962-b8b0-1a6dd81090f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.564278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7217541-151c-4962-b8b0-1a6dd81090f6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.582606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1079/2147] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:17:07.587239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217541-151c-4962-b8b0-1a6dd81090f6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.601073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217541-151c-4962-b8b0-1a6dd81090f6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.606769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a4401-c62e-4395-9702-c0d1983d4b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.607170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a4401-c62e-4395-9702-c0d1983d4b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.607558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a4401-c62e-4395-9702-c0d1983d4b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.607775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a4401-c62e-4395-9702-c0d1983d4b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.608635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a4401-c62e-4395-9702-c0d1983d4b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.610279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a4401-c62e-4395-9702-c0d1983d4b0c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.626512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1080/2148] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:17:07.632276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a4401-c62e-4395-9702-c0d1983d4b0c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.634066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7f6696b887427db8b7218788b35acf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.641267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7f6696b887427db8b7218788b35acf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.642002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7f6696b887427db8b7218788b35acf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.642468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a4401-c62e-4395-9702-c0d1983d4b0c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.648589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.649478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.649709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.650019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] PATH_INFO: `/v3/projects/336ad277875d458b8ad51f1d72386d99/users/4664c0878b7348c6a7bb160abe3c311c/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.652544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7f6696b887427db8b7218788b35acf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.668825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336ad277875d458b8ad51f1d72386d99, user_id=4664c0878b7348c6a7bb160abe3c311c, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.670395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d0d80d6c-78a4-4dfe-9ed5-05fd5dc1d309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7f6696b887427db8b7218788b35acf'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.676351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.681321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1069/2149] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:07 2022] DELETE /identity/v3/users/3a7f6696b887427db8b7218788b35acf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:07.713673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1081/2150] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:07 2022] PUT /identity/v3/projects/336ad277875d458b8ad51f1d72386d99/users/4664c0878b7348c6a7bb160abe3c311c/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:07.734125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8521da-c257-45f9-8664-f19ed7eab619 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.734550 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8521da-c257-45f9-8664-f19ed7eab619 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.734909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8521da-c257-45f9-8664-f19ed7eab619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.775046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3a8521da-c257-45f9-8664-f19ed7eab619 None None] MFA Rules not processed for user `4664c0878b7348c6a7bb160abe3c311c`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:07.777818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a8521da-c257-45f9-8664-f19ed7eab619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.882281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1070/2151] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:07.895004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.897361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.988956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e66df-e211-4972-9215-aa2d5fa8e994 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.992758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d4b8-7409-4fea-beb7-b3b11c3954f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9452756fb5049678dd3aac0d5be651d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.993422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d4b8-7409-4fea-beb7-b3b11c3954f3 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.993728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d4b8-7409-4fea-beb7-b3b11c3954f3 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.994037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d4b8-7409-4fea-beb7-b3b11c3954f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:08.005057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907d4b8-7409-4fea-beb7-b3b11c3954f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:08.006592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907d4b8-7409-4fea-beb7-b3b11c3954f3 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:08.032827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1082/2152] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:08.047889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8521da-c257-45f9-8664-f19ed7eab619 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:08.049505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a8521da-c257-45f9-8664-f19ed7eab619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:08.070778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:08.155466 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8521da-c257-45f9-8664-f19ed7eab619 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:08.160438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:08.161093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:08.161375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:08.161685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] PATH_INFO: `/v3/projects/2b1381e2a1734ebfbd6b358132eed7c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:08.163054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1381e2a1734ebfbd6b358132eed7c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:08.165099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:08.231478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1381e2a1734ebfbd6b358132eed7c6', 'request_id': 'req-8e05856b-c97a-441c-9481-91c9e0e00837'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.244325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1381e2a1734ebfbd6b358132eed7c6', 'request_id': 'req-8e05856b-c97a-441c-9481-91c9e0e00837'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.255386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1381e2a1734ebfbd6b358132eed7c6', 'request_id': 'req-8e05856b-c97a-441c-9481-91c9e0e00837'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.270619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] The token cache is being invalidate because project 2b1381e2a1734ebfbd6b358132eed7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:08.270943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.271584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.273185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1071/2153] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:08 2022] DELETE /identity/v3/projects/2b1381e2a1734ebfbd6b358132eed7c6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:08.277841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d4b8-7409-4fea-beb7-b3b11c3954f3 service glance] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:08.290273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d4b8-7409-4fea-beb7-b3b11c3954f3 service glance] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:08.356229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:08.356868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:08.357149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:08.357427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] PATH_INFO: `/v3/users/9b814e3ca7e8442c8419532036d8284f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:08.358661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b814e3ca7e8442c8419532036d8284f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:08.360961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:08.435334 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b814e3ca7e8442c8419532036d8284f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.457103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b814e3ca7e8442c8419532036d8284f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.458184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b814e3ca7e8442c8419532036d8284f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.479603 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b814e3ca7e8442c8419532036d8284f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.480378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-cc42c6ad-8e07-495d-a833-3ea1fcdd770f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b814e3ca7e8442c8419532036d8284f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.482113 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:08.514562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1083/2154] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:08 2022] DELETE /identity/v3/users/9b814e3ca7e8442c8419532036d8284f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:08.905256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:08.907626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:08.930760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05856b-c97a-441c-9481-91c9e0e00837 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:08.994425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:08.995069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:08.995352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:08.995627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] PATH_INFO: `/v3/projects/9b62000ac4844446a093db4bf07575d5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:08.996865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b62000ac4844446a093db4bf07575d5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:08.998859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.040101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:09.047142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b62000ac4844446a093db4bf07575d5', 'request_id': 'req-c0e0773c-17bc-476a-b22d-446f4f2188bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.054497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b62000ac4844446a093db4bf07575d5', 'request_id': 'req-c0e0773c-17bc-476a-b22d-446f4f2188bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.063451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b62000ac4844446a093db4bf07575d5', 'request_id': 'req-c0e0773c-17bc-476a-b22d-446f4f2188bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.077887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] The token cache is being invalidate because project 9b62000ac4844446a093db4bf07575d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:09.078176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.078908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c0e0773c-17bc-476a-b22d-446f4f2188bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.081031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1072/2155] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:08 2022] DELETE /identity/v3/projects/9b62000ac4844446a093db4bf07575d5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:09.087540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3c44-d75b-4dca-8fc6-15021c2b0794 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.088271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3c44-d75b-4dca-8fc6-15021c2b0794 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.088807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3c44-d75b-4dca-8fc6-15021c2b0794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.113193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9f6a3c44-d75b-4dca-8fc6-15021c2b0794 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:09.114484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9f6a3c44-d75b-4dca-8fc6-15021c2b0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:09.189330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1084/2156] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:09.199388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98e42-faf2-4c42-84fd-2299fa70e2a9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.200067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98e42-faf2-4c42-84fd-2299fa70e2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.200225 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98e42-faf2-4c42-84fd-2299fa70e2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.230510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-69d98e42-faf2-4c42-84fd-2299fa70e2a9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:09.231736 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-69d98e42-faf2-4c42-84fd-2299fa70e2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:09.240352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1073/2157] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:09.244880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a3c44-d75b-4dca-8fc6-15021c2b0794 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.255478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a3c44-d75b-4dca-8fc6-15021c2b0794 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.260154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.260771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.261049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.261321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.261980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:17:09.262316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.263912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.276529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1085/2158] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:17:09.281066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98e42-faf2-4c42-84fd-2299fa70e2a9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.290912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98e42-faf2-4c42-84fd-2299fa70e2a9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.295540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3844-8283-480b-8367-8b742a85feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.296136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3844-8283-480b-8367-8b742a85feff admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.296416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3844-8283-480b-8367-8b742a85feff admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.296683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3844-8283-480b-8367-8b742a85feff admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.297318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e3844-8283-480b-8367-8b742a85feff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.299841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e3844-8283-480b-8367-8b742a85feff admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.328474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1074/2159] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:17:09 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:09.332830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.342990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01d11c-5854-4398-ae62-9bb82f76a3fd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.404831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52751bbb-ae02-4d57-825d-db905560e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.405397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52751bbb-ae02-4d57-825d-db905560e28d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.405736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52751bbb-ae02-4d57-825d-db905560e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.405935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52751bbb-ae02-4d57-825d-db905560e28d admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.406615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52751bbb-ae02-4d57-825d-db905560e28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.409447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52751bbb-ae02-4d57-825d-db905560e28d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.439141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1086/2160] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:17:09 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:17:09.451076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3844-8283-480b-8367-8b742a85feff admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.467328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3844-8283-480b-8367-8b742a85feff admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.479066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f72f66-8092-4d4f-aa3f-7f3872bd3198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.479411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f72f66-8092-4d4f-aa3f-7f3872bd3198 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.480153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f72f66-8092-4d4f-aa3f-7f3872bd3198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.480642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f72f66-8092-4d4f-aa3f-7f3872bd3198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.482156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f72f66-8092-4d4f-aa3f-7f3872bd3198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.485604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f72f66-8092-4d4f-aa3f-7f3872bd3198 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.501376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1075/2161] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:09.506000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52751bbb-ae02-4d57-825d-db905560e28d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.522380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52751bbb-ae02-4d57-825d-db905560e28d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.528895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014620b-e245-4ac0-8bb9-76dea224c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.529716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014620b-e245-4ac0-8bb9-76dea224c4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.530065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014620b-e245-4ac0-8bb9-76dea224c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.530464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014620b-e245-4ac0-8bb9-76dea224c4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.531419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014620b-e245-4ac0-8bb9-76dea224c4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.533900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014620b-e245-4ac0-8bb9-76dea224c4a3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.547585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1087/2162] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:17:09.552277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f72f66-8092-4d4f-aa3f-7f3872bd3198 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.563745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f72f66-8092-4d4f-aa3f-7f3872bd3198 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.571382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defd818-84e4-4213-90a2-f0c463413528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.572165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd818-84e4-4213-90a2-f0c463413528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.572630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd818-84e4-4213-90a2-f0c463413528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.572892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd818-84e4-4213-90a2-f0c463413528 admin admin] PATH_INFO: `/v3/projects/2411531ea1ad40a6a4d164686fefed1a/users/a525c6078be343e1821a449bdd26c745/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.590194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defd818-84e4-4213-90a2-f0c463413528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2411531ea1ad40a6a4d164686fefed1a, user_id=a525c6078be343e1821a449bdd26c745, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.594408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defd818-84e4-4213-90a2-f0c463413528 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.613914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1076/2163] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:09 2022] PUT /identity/v3/projects/2411531ea1ad40a6a4d164686fefed1a/users/a525c6078be343e1821a449bdd26c745/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:09.624373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4486-4153-4b1c-9108-99a3ecaf47cb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.624691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4486-4153-4b1c-9108-99a3ecaf47cb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.624956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4486-4153-4b1c-9108-99a3ecaf47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.655279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-309c4486-4153-4b1c-9108-99a3ecaf47cb None None] MFA Rules not processed for user `a525c6078be343e1821a449bdd26c745`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:09.656942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-309c4486-4153-4b1c-9108-99a3ecaf47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:09.699902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:09.712845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38ecd-9ba7-48b0-af4e-c76d23a948a4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.712845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38ecd-9ba7-48b0-af4e-c76d23a948a4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.712845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38ecd-9ba7-48b0-af4e-c76d23a948a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.749726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d9c38ecd-9ba7-48b0-af4e-c76d23a948a4 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:09.751331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d9c38ecd-9ba7-48b0-af4e-c76d23a948a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:09.799478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1088/2164] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:09.886017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1077/2165] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:09.899882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4486-4153-4b1c-9108-99a3ecaf47cb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.901323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-309c4486-4153-4b1c-9108-99a3ecaf47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:09.991095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4486-4153-4b1c-9108-99a3ecaf47cb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.999571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a00321-4a9b-4f4f-87ef-3ab766d72713 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.000524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a00321-4a9b-4f4f-87ef-3ab766d72713 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.000987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a00321-4a9b-4f4f-87ef-3ab766d72713 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.001467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a00321-4a9b-4f4f-87ef-3ab766d72713 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.021725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a00321-4a9b-4f4f-87ef-3ab766d72713 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.027608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a00321-4a9b-4f4f-87ef-3ab766d72713 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.049991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1089/2166] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:17:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:17:19.877818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:20.039742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=43 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:24.268750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c38ecd-9ba7-48b0-af4e-c76d23a948a4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:24.270719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d9c38ecd-9ba7-48b0-af4e-c76d23a948a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:24.362596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c38ecd-9ba7-48b0-af4e-c76d23a948a4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:24.367588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:24.368259 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:24.368536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:24.368806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] PATH_INFO: `/v3/users/eab61350d5174947a9df267a5bdf19f1` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:24.369985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab61350d5174947a9df267a5bdf19f1)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:24.371929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:24.427407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab61350d5174947a9df267a5bdf19f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:24.435929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab61350d5174947a9df267a5bdf19f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:24.436543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab61350d5174947a9df267a5bdf19f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:24.446723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab61350d5174947a9df267a5bdf19f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:24.460913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab61350d5174947a9df267a5bdf19f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:24.479151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1078/2167] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:24 2022] DELETE /identity/v3/users/eab61350d5174947a9df267a5bdf19f1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:24.483563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602044a-7224-43ca-be60-b550f7d029f5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:24.484018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602044a-7224-43ca-be60-b550f7d029f5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:24.484225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602044a-7224-43ca-be60-b550f7d029f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:24.504220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1602044a-7224-43ca-be60-b550f7d029f5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:24.505439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1602044a-7224-43ca-be60-b550f7d029f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:24.577701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1090/2168] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:24.587783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:24.589229 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:24.666707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e7da-289f-457f-9e48-5a5edd13d2ce admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:24.670782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6c6e3-9c5d-4d45-9b72-2f25efa217e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:24.671430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c6e3-9c5d-4d45-9b72-2f25efa217e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:24.671694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c6e3-9c5d-4d45-9b72-2f25efa217e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:24.671970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c6e3-9c5d-4d45-9b72-2f25efa217e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:24.682619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6c6e3-9c5d-4d45-9b72-2f25efa217e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:24.684062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6c6e3-9c5d-4d45-9b72-2f25efa217e5 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:24.694797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1079/2169] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:25.011108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602044a-7224-43ca-be60-b550f7d029f5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:25.012699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1602044a-7224-43ca-be60-b550f7d029f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:25.024970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602044a-7224-43ca-be60-b550f7d029f5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:25.029664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:25.030421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.030773 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.031119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] PATH_INFO: `/v3/projects/f5a46d86f06040cfa9478aa0e9cf0d84` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.032339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a46d86f06040cfa9478aa0e9cf0d84)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:25.035135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:25.115136 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a46d86f06040cfa9478aa0e9cf0d84', 'request_id': 'req-0b9523da-01c8-47e4-ba62-67b2418d36a0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:25.122010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a46d86f06040cfa9478aa0e9cf0d84', 'request_id': 'req-0b9523da-01c8-47e4-ba62-67b2418d36a0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:25.128857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a46d86f06040cfa9478aa0e9cf0d84', 'request_id': 'req-0b9523da-01c8-47e4-ba62-67b2418d36a0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:25.143785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] The token cache is being invalidate because project f5a46d86f06040cfa9478aa0e9cf0d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:25.144042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:25.144674 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b9523da-01c8-47e4-ba62-67b2418d36a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:25.146158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1091/2170] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:25 2022] DELETE /identity/v3/projects/f5a46d86f06040cfa9478aa0e9cf0d84 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:25.151825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7113-612e-4bdf-8529-9f43beac5d2d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.152195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7113-612e-4bdf-8529-9f43beac5d2d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.152479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7113-612e-4bdf-8529-9f43beac5d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.174798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-38bd7113-612e-4bdf-8529-9f43beac5d2d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:25.176010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-38bd7113-612e-4bdf-8529-9f43beac5d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:25.193653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:25.237355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1080/2171] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:25.245104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c31096-0d31-4141-b8eb-92555d407dfd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.245391 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c31096-0d31-4141-b8eb-92555d407dfd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.245670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c31096-0d31-4141-b8eb-92555d407dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.266561 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d5c31096-0d31-4141-b8eb-92555d407dfd None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:25.268414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d5c31096-0d31-4141-b8eb-92555d407dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:25.276245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1092/2172] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:25.280538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7113-612e-4bdf-8529-9f43beac5d2d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:25.290803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7113-612e-4bdf-8529-9f43beac5d2d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:25.295449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:25.296056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.296337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.296611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.297258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:17:25.297565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:25.299216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:25.311497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1081/2173] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:17:25.316531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c31096-0d31-4141-b8eb-92555d407dfd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:25.326406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c31096-0d31-4141-b8eb-92555d407dfd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:25.332100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4181979-47bf-481b-bb5f-5b469685d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:25.332713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4181979-47bf-481b-bb5f-5b469685d591 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.333032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4181979-47bf-481b-bb5f-5b469685d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.333268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4181979-47bf-481b-bb5f-5b469685d591 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.333902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4181979-47bf-481b-bb5f-5b469685d591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:25.335863 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4181979-47bf-481b-bb5f-5b469685d591 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:25.364277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1093/2174] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:17:25 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:25.375775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:25.397485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980f9a6-b7bc-47b1-b263-77c92f6a7242 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:25.458785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c98ab-f578-4ca2-b3a8-dcc3d6fc1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:25.459989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c98ab-f578-4ca2-b3a8-dcc3d6fc1de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.460375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c98ab-f578-4ca2-b3a8-dcc3d6fc1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.460828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c98ab-f578-4ca2-b3a8-dcc3d6fc1de2 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.461901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c98ab-f578-4ca2-b3a8-dcc3d6fc1de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:25.465430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c98ab-f578-4ca2-b3a8-dcc3d6fc1de2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:25.498097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1082/2175] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:17:25 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:25.499375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4181979-47bf-481b-bb5f-5b469685d591 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:25.511418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4181979-47bf-481b-bb5f-5b469685d591 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:25.516479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7ee1-5396-4d2f-9195-4dc1ef822f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:25.517754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7ee1-5396-4d2f-9195-4dc1ef822f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.517980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7ee1-5396-4d2f-9195-4dc1ef822f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.518281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7ee1-5396-4d2f-9195-4dc1ef822f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.518938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e7ee1-5396-4d2f-9195-4dc1ef822f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:25.520542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e7ee1-5396-4d2f-9195-4dc1ef822f8f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:25.531170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1094/2176] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:17:25.535497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c98ab-f578-4ca2-b3a8-dcc3d6fc1de2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:25.547213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c98ab-f578-4ca2-b3a8-dcc3d6fc1de2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:25.556096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f77e9-972b-4f25-b1b6-cd0b4009e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:25.556814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f77e9-972b-4f25-b1b6-cd0b4009e93c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.557179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f77e9-972b-4f25-b1b6-cd0b4009e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.557540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f77e9-972b-4f25-b1b6-cd0b4009e93c admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.558295 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f77e9-972b-4f25-b1b6-cd0b4009e93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:25.560206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f77e9-972b-4f25-b1b6-cd0b4009e93c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:25.575909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1083/2177] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:25.582806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7ee1-5396-4d2f-9195-4dc1ef822f8f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:25.594879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7ee1-5396-4d2f-9195-4dc1ef822f8f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:25.600096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:25.600763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.601044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.601324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] PATH_INFO: `/v3/projects/1f6b2290ae8e4e7dbfeeaf0a65e90be6/users/acea90d3cea3499ab48c5b471037019a/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.617164 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6b2290ae8e4e7dbfeeaf0a65e90be6, user_id=acea90d3cea3499ab48c5b471037019a, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:25.619856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:25.635376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1095/2178] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:25 2022] PUT /identity/v3/projects/1f6b2290ae8e4e7dbfeeaf0a65e90be6/users/acea90d3cea3499ab48c5b471037019a/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:25.651426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009462-378d-4771-8697-c6e75a6f3bb4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.651731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009462-378d-4771-8697-c6e75a6f3bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.652003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009462-378d-4771-8697-c6e75a6f3bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.683558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9d009462-378d-4771-8697-c6e75a6f3bb4 None None] MFA Rules not processed for user `acea90d3cea3499ab48c5b471037019a`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:25.684684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9d009462-378d-4771-8697-c6e75a6f3bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:25.750220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1084/2179] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:25.762449 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:25.764159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:25.788008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:25.834484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b429790-7deb-4de7-b568-4eb3dd6e38c4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:25.838571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:25.839186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:25.839467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:25.839741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:25.849298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:25.850828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:25.862336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1096/2180] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:17:35.747261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:35.856838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=17 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:17.941813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d009462-378d-4771-8697-c6e75a6f3bb4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:17.943570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9d009462-378d-4771-8697-c6e75a6f3bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:17.999889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d009462-378d-4771-8697-c6e75a6f3bb4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:18.004092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbefcce-293e-418f-8cf8-b906d8904d82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9452756fb5049678dd3aac0d5be651d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:18.004747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbefcce-293e-418f-8cf8-b906d8904d82 service glance] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:18.004985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbefcce-293e-418f-8cf8-b906d8904d82 service glance] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:18.005260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbefcce-293e-418f-8cf8-b906d8904d82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:18.007103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-afbefcce-293e-418f-8cf8-b906d8904d82 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:18.066244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbefcce-293e-418f-8cf8-b906d8904d82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:18.067986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbefcce-293e-418f-8cf8-b906d8904d82 service glance] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:18.077902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1085/2181] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:18:28.073480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=48 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:46.438960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:46.440499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:46.533297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562614-8a12-459d-83ae-6fcbae06b50e service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:46.538488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:46.539372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:46.539654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:46.539930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] PATH_INFO: `/v3/users/4664c0878b7348c6a7bb160abe3c311c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:46.541125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4664c0878b7348c6a7bb160abe3c311c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:46.543117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:46.598870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4664c0878b7348c6a7bb160abe3c311c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:46.607446 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4664c0878b7348c6a7bb160abe3c311c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:46.608249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4664c0878b7348c6a7bb160abe3c311c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:46.617192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4664c0878b7348c6a7bb160abe3c311c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:46.617855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4664c0878b7348c6a7bb160abe3c311c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:46.640125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1097/2182] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:18:46 2022] DELETE /identity/v3/users/4664c0878b7348c6a7bb160abe3c311c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:46.645616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ac1ff-9f6f-4fb0-a32f-45e2b3034292 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:46.646168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ac1ff-9f6f-4fb0-a32f-45e2b3034292 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:46.646168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ac1ff-9f6f-4fb0-a32f-45e2b3034292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:46.667773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-262ac1ff-9f6f-4fb0-a32f-45e2b3034292 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:46.669383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-262ac1ff-9f6f-4fb0-a32f-45e2b3034292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:46.752585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1086/2183] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:46.763310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:46.764830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:46.850643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c965a3-e795-4211-a8c3-f24ebe17bea0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:46.857202 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddcb10-bfad-49fd-85bb-c7b40b83b497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:46.858456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddcb10-bfad-49fd-85bb-c7b40b83b497 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:46.858809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddcb10-bfad-49fd-85bb-c7b40b83b497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:46.859075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddcb10-bfad-49fd-85bb-c7b40b83b497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:46.871239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddcb10-bfad-49fd-85bb-c7b40b83b497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:46.875195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddcb10-bfad-49fd-85bb-c7b40b83b497 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:46.887288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1098/2184] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:18:47.014320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ac1ff-9f6f-4fb0-a32f-45e2b3034292 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.015857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-262ac1ff-9f6f-4fb0-a32f-45e2b3034292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:47.027967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ac1ff-9f6f-4fb0-a32f-45e2b3034292 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.032619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.033320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.033696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.034091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] PATH_INFO: `/v3/users/acea90d3cea3499ab48c5b471037019a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.035354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=acea90d3cea3499ab48c5b471037019a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.037318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:47.097039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acea90d3cea3499ab48c5b471037019a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.105566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acea90d3cea3499ab48c5b471037019a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.106347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acea90d3cea3499ab48c5b471037019a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.118488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acea90d3cea3499ab48c5b471037019a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.136702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acea90d3cea3499ab48c5b471037019a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.152595 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1087/2185] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:18:47 2022] DELETE /identity/v3/users/acea90d3cea3499ab48c5b471037019a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:47.157128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90f578-cb8b-4278-a873-78746d24ec74 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.157416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90f578-cb8b-4278-a873-78746d24ec74 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.157697 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90f578-cb8b-4278-a873-78746d24ec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.181913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bc90f578-cb8b-4278-a873-78746d24ec74 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:47.183570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bc90f578-cb8b-4278-a873-78746d24ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:47.194101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.196069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:47.239121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:47.301480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1099/2186] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:47.315257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90f578-cb8b-4278-a873-78746d24ec74 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.316867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bc90f578-cb8b-4278-a873-78746d24ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:47.339515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65b3e0-059b-4a43-bc7e-3bfaeeac5cda admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.344960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.345609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.345887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.346175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] PATH_INFO: `/v3/projects/336ad277875d458b8ad51f1d72386d99` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.347350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336ad277875d458b8ad51f1d72386d99)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.349575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:47.370413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:47.397026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90f578-cb8b-4278-a873-78746d24ec74 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.410861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336ad277875d458b8ad51f1d72386d99', 'request_id': 'req-85e8d7cd-943e-4638-9626-9b7c199d0726'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.418806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336ad277875d458b8ad51f1d72386d99', 'request_id': 'req-85e8d7cd-943e-4638-9626-9b7c199d0726'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.431739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336ad277875d458b8ad51f1d72386d99', 'request_id': 'req-85e8d7cd-943e-4638-9626-9b7c199d0726'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.454451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] The token cache is being invalidate because project 336ad277875d458b8ad51f1d72386d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:18:47.454804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.458198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-85e8d7cd-943e-4638-9626-9b7c199d0726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:47.460084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1088/2187] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:18:47 2022] DELETE /identity/v3/projects/336ad277875d458b8ad51f1d72386d99 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:47.463632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.464582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.464971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.465294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.466456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd72a6-b93d-4a4b-9cc5-db8fc07694db None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.466725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd72a6-b93d-4a4b-9cc5-db8fc07694db None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.467003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd72a6-b93d-4a4b-9cc5-db8fc07694db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.467688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:47.489530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-93bd72a6-b93d-4a4b-9cc5-db8fc07694db None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:47.490984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-93bd72a6-b93d-4a4b-9cc5-db8fc07694db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:47.549637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.551500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:47.559030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1089/2188] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:47.561754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1100/2189] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:18:47.567197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f7b5-6695-4309-a878-1f027f214712 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.570137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f7b5-6695-4309-a878-1f027f214712 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.570584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f7b5-6695-4309-a878-1f027f214712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.597018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d205f7b5-6695-4309-a878-1f027f214712 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:47.598306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d205f7b5-6695-4309-a878-1f027f214712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:47.607591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1090/2190] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:47.615573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.637092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732c09-4433-4d4e-a5be-b75a26d8975e service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.642770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.643644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.643981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.644254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.644938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:18:47.645245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.646973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:47.666016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1101/2191] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:18:47.670391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f7b5-6695-4309-a878-1f027f214712 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.684529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f7b5-6695-4309-a878-1f027f214712 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.698517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.698517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.698517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.698517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.698843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.698843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:47.755764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1091/2192] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:18:47 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:47.761776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.775830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dd06b-4897-4175-a69e-ba3e95092b9b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.793131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:47.853914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da67292-13b9-4ef7-9e60-5a9c9818c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.854519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67292-13b9-4ef7-9e60-5a9c9818c496 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.854881 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67292-13b9-4ef7-9e60-5a9c9818c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.855211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67292-13b9-4ef7-9e60-5a9c9818c496 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.856136 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67292-13b9-4ef7-9e60-5a9c9818c496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.858617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67292-13b9-4ef7-9e60-5a9c9818c496 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:47.906289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1102/2193] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:18:47 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:47.906987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.906987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:47.911972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da67292-13b9-4ef7-9e60-5a9c9818c496 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.925349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da67292-13b9-4ef7-9e60-5a9c9818c496 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.932708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2aeee-0600-486e-a94e-6994049eea89 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.937096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.937874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.938447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.938788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] PATH_INFO: `/v3/projects/1f6b2290ae8e4e7dbfeeaf0a65e90be6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.940252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6b2290ae8e4e7dbfeeaf0a65e90be6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.942162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:47.947053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3c77-143a-40a8-909f-93d6ea11bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.947682 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3c77-143a-40a8-909f-93d6ea11bc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.947978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3c77-143a-40a8-909f-93d6ea11bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.948241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3c77-143a-40a8-909f-93d6ea11bc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.949541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd3c77-143a-40a8-909f-93d6ea11bc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.951351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd3c77-143a-40a8-909f-93d6ea11bc83 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:47.967454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1103/2194] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:18:47.968909 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3c77-143a-40a8-909f-93d6ea11bc83 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:47.982420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3c77-143a-40a8-909f-93d6ea11bc83 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:47.993578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa75c-3fa8-44df-93d1-fadfbd5e7282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:47.994762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa75c-3fa8-44df-93d1-fadfbd5e7282 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:47.995115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa75c-3fa8-44df-93d1-fadfbd5e7282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:47.995526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa75c-3fa8-44df-93d1-fadfbd5e7282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:47.996775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aa75c-3fa8-44df-93d1-fadfbd5e7282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:47.999180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aa75c-3fa8-44df-93d1-fadfbd5e7282 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.012716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1104/2195] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:18:48.014663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6b2290ae8e4e7dbfeeaf0a65e90be6', 'request_id': 'req-cc0c2b52-6259-437b-9a6f-ed3a41aae805'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:48.017871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa75c-3fa8-44df-93d1-fadfbd5e7282 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.021757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6b2290ae8e4e7dbfeeaf0a65e90be6', 'request_id': 'req-cc0c2b52-6259-437b-9a6f-ed3a41aae805'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:48.035368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6b2290ae8e4e7dbfeeaf0a65e90be6', 'request_id': 'req-cc0c2b52-6259-437b-9a6f-ed3a41aae805'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:48.038051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa75c-3fa8-44df-93d1-fadfbd5e7282 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.048362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:48.054384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] The token cache is being invalidate because project 1f6b2290ae8e4e7dbfeeaf0a65e90be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:18:48.055186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:48.056383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cc0c2b52-6259-437b-9a6f-ed3a41aae805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:48.063122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1092/2196] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:18:47 2022] DELETE /identity/v3/projects/1f6b2290ae8e4e7dbfeeaf0a65e90be6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:48.064683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac37fbf-aa8e-4d2e-be0d-49532cfb8078 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.064977 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac37fbf-aa8e-4d2e-be0d-49532cfb8078 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.065258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac37fbf-aa8e-4d2e-be0d-49532cfb8078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.091877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fac37fbf-aa8e-4d2e-be0d-49532cfb8078 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:48.093379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fac37fbf-aa8e-4d2e-be0d-49532cfb8078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:48.117155 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cdfc8-b4b1-4568-be98-3a40dcf93cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.118119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cdfc8-b4b1-4568-be98-3a40dcf93cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.118770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cdfc8-b4b1-4568-be98-3a40dcf93cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.119135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cdfc8-b4b1-4568-be98-3a40dcf93cf8 admin admin] PATH_INFO: `/v3/projects/b4f057ae131e47bea0d8faec3ad37c0a/users/b7f65bfd18854720ab3555d94d038859/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.136259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cdfc8-b4b1-4568-be98-3a40dcf93cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f057ae131e47bea0d8faec3ad37c0a, user_id=b7f65bfd18854720ab3555d94d038859, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.139004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cdfc8-b4b1-4568-be98-3a40dcf93cf8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.156041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1105/2197] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:48 2022] PUT /identity/v3/projects/b4f057ae131e47bea0d8faec3ad37c0a/users/b7f65bfd18854720ab3555d94d038859/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:48.162011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1093/2198] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:48.168324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96a02-f86c-4565-8ffc-f597c2e822fe None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.168856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96a02-f86c-4565-8ffc-f597c2e822fe None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.168970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96a02-f86c-4565-8ffc-f597c2e822fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.170677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af5286-831e-43a6-9540-e9153c002ca7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.170993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af5286-831e-43a6-9540-e9153c002ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.171287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af5286-831e-43a6-9540-e9153c002ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.191832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-15af5286-831e-43a6-9540-e9153c002ca7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:48.193170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-15af5286-831e-43a6-9540-e9153c002ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:48.201660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-96c96a02-f86c-4565-8ffc-f597c2e822fe None None] MFA Rules not processed for user `b7f65bfd18854720ab3555d94d038859`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:48.202987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-96c96a02-f86c-4565-8ffc-f597c2e822fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:48.264119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1094/2199] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:48.268642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af5286-831e-43a6-9540-e9153c002ca7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.274244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:48.284842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1106/2200] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:48.287297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af5286-831e-43a6-9540-e9153c002ca7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.291228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c96a02-f86c-4565-8ffc-f597c2e822fe None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.293947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-96c96a02-f86c-4565-8ffc-f597c2e822fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:48.295018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.295633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.295909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.296180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.296826 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:18:48.297129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.298759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.311460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c96a02-f86c-4565-8ffc-f597c2e822fe None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.317426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1095/2201] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:18:48.317826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdc636-1920-46d8-847d-52d9089be886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.317826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdc636-1920-46d8-847d-52d9089be886 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.317826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdc636-1920-46d8-847d-52d9089be886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.317826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdc636-1920-46d8-847d-52d9089be886 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.318163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdc636-1920-46d8-847d-52d9089be886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.318238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.328729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdc636-1920-46d8-847d-52d9089be886 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.329273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f4902-fa5c-4311-987e-549995970844 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.334077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb216-413e-4f93-a01e-065664259776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.334860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb216-413e-4f93-a01e-065664259776 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.335161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb216-413e-4f93-a01e-065664259776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.335511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb216-413e-4f93-a01e-065664259776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.336131 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eb216-413e-4f93-a01e-065664259776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.338210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eb216-413e-4f93-a01e-065664259776 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.377186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1107/2202] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:18:48.384969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdc636-1920-46d8-847d-52d9089be886 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.397596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1096/2203] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:18:48.402449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb216-413e-4f93-a01e-065664259776 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.500162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb216-413e-4f93-a01e-065664259776 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.511706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646da2-0293-4265-a255-85181ec447d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.512392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646da2-0293-4265-a255-85181ec447d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.512827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646da2-0293-4265-a255-85181ec447d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.513106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36646da2-0293-4265-a255-85181ec447d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.514117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36646da2-0293-4265-a255-85181ec447d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.516150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdc636-1920-46d8-847d-52d9089be886 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.516605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36646da2-0293-4265-a255-85181ec447d2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.521504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d514c7f-dc22-4836-b789-77d85a60918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.522217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d514c7f-dc22-4836-b789-77d85a60918e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.523466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d514c7f-dc22-4836-b789-77d85a60918e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.523753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d514c7f-dc22-4836-b789-77d85a60918e admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.530249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d514c7f-dc22-4836-b789-77d85a60918e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.530249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d514c7f-dc22-4836-b789-77d85a60918e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.530586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:48.546462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1097/2204] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:18:48.550733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646da2-0293-4265-a255-85181ec447d2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.555401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1108/2205] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:18:48.559764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d514c7f-dc22-4836-b789-77d85a60918e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.561840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36646da2-0293-4265-a255-85181ec447d2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.566774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631e57e-c7fa-4773-8e0f-d4bc1dc5a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.567388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631e57e-c7fa-4773-8e0f-d4bc1dc5a806 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.567669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631e57e-c7fa-4773-8e0f-d4bc1dc5a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.567973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631e57e-c7fa-4773-8e0f-d4bc1dc5a806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.568628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631e57e-c7fa-4773-8e0f-d4bc1dc5a806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.571149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631e57e-c7fa-4773-8e0f-d4bc1dc5a806 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.572298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d514c7f-dc22-4836-b789-77d85a60918e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.577469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1cbc-a766-4542-b879-6e17d2a3b8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.578189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1cbc-a766-4542-b879-6e17d2a3b8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.578501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1cbc-a766-4542-b879-6e17d2a3b8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.578914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1cbc-a766-4542-b879-6e17d2a3b8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.579606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1cbc-a766-4542-b879-6e17d2a3b8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.581236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1cbc-a766-4542-b879-6e17d2a3b8fa admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.582353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1098/2206] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:48.587534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631e57e-c7fa-4773-8e0f-d4bc1dc5a806 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.595800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1109/2207] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:48.599794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1cbc-a766-4542-b879-6e17d2a3b8fa admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.601759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631e57e-c7fa-4773-8e0f-d4bc1dc5a806 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.608679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdff931-c75c-4484-8a11-9263626f4156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.609474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff931-c75c-4484-8a11-9263626f4156 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.609815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff931-c75c-4484-8a11-9263626f4156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.610161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff931-c75c-4484-8a11-9263626f4156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.610913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdff931-c75c-4484-8a11-9263626f4156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.611076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1cbc-a766-4542-b879-6e17d2a3b8fa admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.612891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdff931-c75c-4484-8a11-9263626f4156 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.617235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ce6d8-357e-4678-aab0-b91e33df2b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.617910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ce6d8-357e-4678-aab0-b91e33df2b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.618189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ce6d8-357e-4678-aab0-b91e33df2b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.618565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ce6d8-357e-4678-aab0-b91e33df2b44 admin admin] PATH_INFO: `/v3/projects/c6736b943ba54e84a15bc802091d6dc8/users/4349138f18224f8ebc5c96c70b4b5d75/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.630057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1099/2208] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:48.635110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdff931-c75c-4484-8a11-9263626f4156 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.640181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ce6d8-357e-4678-aab0-b91e33df2b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6736b943ba54e84a15bc802091d6dc8, user_id=4349138f18224f8ebc5c96c70b4b5d75, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.644894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdff931-c75c-4484-8a11-9263626f4156 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.645678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ce6d8-357e-4678-aab0-b91e33df2b44 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.651892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4633a3-dfd0-4da3-a6b9-fb8d2679e92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.653023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4633a3-dfd0-4da3-a6b9-fb8d2679e92d admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.653592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4633a3-dfd0-4da3-a6b9-fb8d2679e92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.653868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4633a3-dfd0-4da3-a6b9-fb8d2679e92d admin admin] PATH_INFO: `/v3/projects/82d7e2503aa043929798769c22c1b2da/users/d713712c30574895b82beedb9c4f251d/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.664235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1110/2209] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:48 2022] PUT /identity/v3/projects/c6736b943ba54e84a15bc802091d6dc8/users/4349138f18224f8ebc5c96c70b4b5d75/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:48.668365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ce6d8-357e-4678-aab0-b91e33df2b44 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.672157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4633a3-dfd0-4da3-a6b9-fb8d2679e92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d7e2503aa043929798769c22c1b2da, user_id=d713712c30574895b82beedb9c4f251d, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.674895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4633a3-dfd0-4da3-a6b9-fb8d2679e92d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.689077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1100/2210] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:48 2022] PUT /identity/v3/projects/82d7e2503aa043929798769c22c1b2da/users/d713712c30574895b82beedb9c4f251d/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:48.693871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7f7f-89b0-49d9-a031-1392f858797f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.694167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7f7f-89b0-49d9-a031-1392f858797f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.694501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d7f7f-89b0-49d9-a031-1392f858797f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.715159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d67d7f7f-89b0-49d9-a031-1392f858797f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:48.716508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d67d7f7f-89b0-49d9-a031-1392f858797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:48.733117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ce6d8-357e-4678-aab0-b91e33df2b44 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.770795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:48.787341 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1101/2211] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:48.798115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7f7f-89b0-49d9-a031-1392f858797f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.799884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d67d7f7f-89b0-49d9-a031-1392f858797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:48.813392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976c8d2-76e4-4fef-ae55-c4c3d2f88460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.815037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c8d2-76e4-4fef-ae55-c4c3d2f88460 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.815474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c8d2-76e4-4fef-ae55-c4c3d2f88460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.815948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c8d2-76e4-4fef-ae55-c4c3d2f88460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.817373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976c8d2-76e4-4fef-ae55-c4c3d2f88460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.821327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976c8d2-76e4-4fef-ae55-c4c3d2f88460 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.840521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1111/2212] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:48.843335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976c8d2-76e4-4fef-ae55-c4c3d2f88460 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:48.858047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976c8d2-76e4-4fef-ae55-c4c3d2f88460 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.864129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10494075-8cdc-4441-8f07-40a7de838625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.864804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494075-8cdc-4441-8f07-40a7de838625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.865089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494075-8cdc-4441-8f07-40a7de838625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.865366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494075-8cdc-4441-8f07-40a7de838625 admin admin] PATH_INFO: `/v3/projects/c6736b943ba54e84a15bc802091d6dc8/users/4349138f18224f8ebc5c96c70b4b5d75/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.868037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494075-8cdc-4441-8f07-40a7de838625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6736b943ba54e84a15bc802091d6dc8, user_id=4349138f18224f8ebc5c96c70b4b5d75, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.870815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494075-8cdc-4441-8f07-40a7de838625 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.872412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d7f7f-89b0-49d9-a031-1392f858797f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:48.876616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:48.877506 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.877869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.878069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.892306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1112/2213] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:48 2022] PUT /identity/v3/projects/c6736b943ba54e84a15bc802091d6dc8/users/4349138f18224f8ebc5c96c70b4b5d75/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:48.892539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:48.892539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:48.895621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d1644-edc2-4c80-bbf9-3ed87b0d7922 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:48.895985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d1644-edc2-4c80-bbf9-3ed87b0d7922 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:48.896269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d1644-edc2-4c80-bbf9-3ed87b0d7922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:48.902624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1102/2214] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:18:48.940451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-381d1644-edc2-4c80-bbf9-3ed87b0d7922 None None] MFA Rules not processed for user `4349138f18224f8ebc5c96c70b4b5d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:48.941872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-381d1644-edc2-4c80-bbf9-3ed87b0d7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:49.056516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1113/2215] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:49.069073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:49.070675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:49.152369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac4bbf-32dd-4e66-90ed-16f2b02b9a80 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:49.157807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:49.226010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b0a8-b669-48fe-8dcd-d055e11a42cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:49.227023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b0a8-b669-48fe-8dcd-d055e11a42cc service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:49.241297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b0a8-b669-48fe-8dcd-d055e11a42cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:49.241297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b0a8-b669-48fe-8dcd-d055e11a42cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:49.296085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9b0a8-b669-48fe-8dcd-d055e11a42cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:49.300183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9b0a8-b669-48fe-8dcd-d055e11a42cc service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:49.310072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1103/2216] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:18:49.787300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4880dc-0f4c-4089-8486-a6927c5b9286 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:49.787897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4880dc-0f4c-4089-8486-a6927c5b9286 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:49.788078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4880dc-0f4c-4089-8486-a6927c5b9286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:49.819821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5d4880dc-0f4c-4089-8486-a6927c5b9286 None None] MFA Rules not processed for user `d713712c30574895b82beedb9c4f251d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:49.821069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5d4880dc-0f4c-4089-8486-a6927c5b9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:49.898549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1114/2217] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:49.906834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b0a8-b669-48fe-8dcd-d055e11a42cc service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:49.916121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b0a8-b669-48fe-8dcd-d055e11a42cc service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:49.919791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaca6c-b1ec-4cc7-992c-473f893ba110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:49.920409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaca6c-b1ec-4cc7-992c-473f893ba110 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:49.920691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaca6c-b1ec-4cc7-992c-473f893ba110 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:49.920966 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaca6c-b1ec-4cc7-992c-473f893ba110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:49.932301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaca6c-b1ec-4cc7-992c-473f893ba110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:49.933000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaca6c-b1ec-4cc7-992c-473f893ba110 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:49.943012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1104/2218] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:18:51.183269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4880dc-0f4c-4089-8486-a6927c5b9286 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:51.184724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5d4880dc-0f4c-4089-8486-a6927c5b9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:51.223676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:51.259954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4880dc-0f4c-4089-8486-a6927c5b9286 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:51.265349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:51.265980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:51.266294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:51.266573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] PATH_INFO: `/v3/users/43c32915a7aa40dcb02a2eea277acfe6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:51.267779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c32915a7aa40dcb02a2eea277acfe6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:51.269850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:51.322384 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c32915a7aa40dcb02a2eea277acfe6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:51.329970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c32915a7aa40dcb02a2eea277acfe6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:51.330999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c32915a7aa40dcb02a2eea277acfe6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:51.352202 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c32915a7aa40dcb02a2eea277acfe6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:51.352939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-60bc9fc6-0661-4931-aa31-d9caa6d72330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c32915a7aa40dcb02a2eea277acfe6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:51.385869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1115/2219] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:18:51 2022] DELETE /identity/v3/users/43c32915a7aa40dcb02a2eea277acfe6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:51.386665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e1741-9a65-47b2-8e67-09118f786f6b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:51.387097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e1741-9a65-47b2-8e67-09118f786f6b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:51.389346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e1741-9a65-47b2-8e67-09118f786f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:51.405116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff1fc-e5b2-4a8c-a1b3-6ce07402e4ce None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:51.405457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff1fc-e5b2-4a8c-a1b3-6ce07402e4ce None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:51.405764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff1fc-e5b2-4a8c-a1b3-6ce07402e4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:51.423573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5e5e1741-9a65-47b2-8e67-09118f786f6b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:51.427620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5e5e1741-9a65-47b2-8e67-09118f786f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:51.440826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d13ff1fc-e5b2-4a8c-a1b3-6ce07402e4ce None None] MFA Rules not processed for user `d713712c30574895b82beedb9c4f251d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:51.442222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d13ff1fc-e5b2-4a8c-a1b3-6ce07402e4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:51.514924 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1116/2220] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:51.523349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1105/2221] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:51.541378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ff1fc-e5b2-4a8c-a1b3-6ce07402e4ce None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:51.542947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d13ff1fc-e5b2-4a8c-a1b3-6ce07402e4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:51.618126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ff1fc-e5b2-4a8c-a1b3-6ce07402e4ce None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:51.621744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:51.622469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:51.622748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:51.623026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:51.633626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:51.635264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:51.640570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:51.646295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1117/2222] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:18:52.020882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e1741-9a65-47b2-8e67-09118f786f6b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.024253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5e5e1741-9a65-47b2-8e67-09118f786f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:52.038656 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e1741-9a65-47b2-8e67-09118f786f6b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.043839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.044627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.045308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.045679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] PATH_INFO: `/v3/users/b7f65bfd18854720ab3555d94d038859` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.047031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f65bfd18854720ab3555d94d038859)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.049508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.115204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:52.122023 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f65bfd18854720ab3555d94d038859'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.129204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.131304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:52.131597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f65bfd18854720ab3555d94d038859'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.132578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f65bfd18854720ab3555d94d038859'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.150437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f65bfd18854720ab3555d94d038859'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.151948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13124db-f0b8-4c82-84be-89ae9bb99a5b service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.159220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.161245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.161783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.162209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] PATH_INFO: `/v3/projects/b464ddedeb3b4109b5558c8b32705ef9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.164431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b464ddedeb3b4109b5558c8b32705ef9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.166883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.180562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3f0f45c9-86f3-4a91-95a1-b3737eef2cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f65bfd18854720ab3555d94d038859'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.188077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1106/2223] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:18:52 2022] DELETE /identity/v3/users/b7f65bfd18854720ab3555d94d038859 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:52.193305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056801ad-56eb-41a8-9d3f-bb0d78105eff None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.193835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056801ad-56eb-41a8-9d3f-bb0d78105eff None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.194701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056801ad-56eb-41a8-9d3f-bb0d78105eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.224810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-056801ad-56eb-41a8-9d3f-bb0d78105eff None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:52.226793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-056801ad-56eb-41a8-9d3f-bb0d78105eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:52.253463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b464ddedeb3b4109b5558c8b32705ef9', 'request_id': 'req-694d53a5-9bea-4256-8b70-868f3432406d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.260977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b464ddedeb3b4109b5558c8b32705ef9', 'request_id': 'req-694d53a5-9bea-4256-8b70-868f3432406d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.267598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b464ddedeb3b4109b5558c8b32705ef9', 'request_id': 'req-694d53a5-9bea-4256-8b70-868f3432406d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.301906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] The token cache is being invalidate because project b464ddedeb3b4109b5558c8b32705ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:18:52.302245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.305786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-694d53a5-9bea-4256-8b70-868f3432406d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:52.307743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1118/2224] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:18:52 2022] DELETE /identity/v3/projects/b464ddedeb3b4109b5558c8b32705ef9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:52.312690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234525-0cd8-4cb6-b9d3-62096121f643 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.312983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234525-0cd8-4cb6-b9d3-62096121f643 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.313268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234525-0cd8-4cb6-b9d3-62096121f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.345577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9f234525-0cd8-4cb6-b9d3-62096121f643 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:52.348955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1107/2225] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:52.349199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9f234525-0cd8-4cb6-b9d3-62096121f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:52.364527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056801ad-56eb-41a8-9d3f-bb0d78105eff None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.367648 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-056801ad-56eb-41a8-9d3f-bb0d78105eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:52.368351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1119/2226] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:52.378308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e52e2-4673-493d-b8ce-df19e64575c9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.378610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e52e2-4673-493d-b8ce-df19e64575c9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.378877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e52e2-4673-493d-b8ce-df19e64575c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.418548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e56e52e2-4673-493d-b8ce-df19e64575c9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:52.418548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e56e52e2-4673-493d-b8ce-df19e64575c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:52.426533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1120/2227] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:52.427906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e52e2-4673-493d-b8ce-df19e64575c9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.440461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e52e2-4673-493d-b8ce-df19e64575c9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.445993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056801ad-56eb-41a8-9d3f-bb0d78105eff None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.449772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f67edc-9f8e-4e4b-926f-de2802611471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.450463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f67edc-9f8e-4e4b-926f-de2802611471 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.450749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f67edc-9f8e-4e4b-926f-de2802611471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.451031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f67edc-9f8e-4e4b-926f-de2802611471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.463833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.464638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.465063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.465910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.466787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:18:52.467238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.469265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.471869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f67edc-9f8e-4e4b-926f-de2802611471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.473298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f67edc-9f8e-4e4b-926f-de2802611471 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.484136 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1108/2228] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:18:52.493090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1121/2229] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:18:52.497493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f67edc-9f8e-4e4b-926f-de2802611471 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.509217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f67edc-9f8e-4e4b-926f-de2802611471 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.519540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29212cb6-1026-482b-8d14-0529c3d91993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.520608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212cb6-1026-482b-8d14-0529c3d91993 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.521103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212cb6-1026-482b-8d14-0529c3d91993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.521676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29212cb6-1026-482b-8d14-0529c3d91993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.523340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29212cb6-1026-482b-8d14-0529c3d91993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.526174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29212cb6-1026-482b-8d14-0529c3d91993 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.577032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1109/2230] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:18:52 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:52.582033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.607085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc34a-a23c-4cd0-976e-b9ac9d41af85 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.736785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a1b7-e970-4eda-8f0c-925afec447d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.737737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a1b7-e970-4eda-8f0c-925afec447d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.738084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a1b7-e970-4eda-8f0c-925afec447d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.738503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a1b7-e970-4eda-8f0c-925afec447d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.739195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a1b7-e970-4eda-8f0c-925afec447d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.755178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a1b7-e970-4eda-8f0c-925afec447d0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.815526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1122/2231] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:18:52 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:52.820049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29212cb6-1026-482b-8d14-0529c3d91993 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.838188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29212cb6-1026-482b-8d14-0529c3d91993 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.852101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.855246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.855752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.856043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.856738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.858994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.875799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1110/2232] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:18:52.877087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a1b7-e970-4eda-8f0c-925afec447d0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.891352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a1b7-e970-4eda-8f0c-925afec447d0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.896988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113fa87-10e0-40f4-aea7-f7dacaa4bd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.899705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113fa87-10e0-40f4-aea7-f7dacaa4bd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.899995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113fa87-10e0-40f4-aea7-f7dacaa4bd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.900275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113fa87-10e0-40f4-aea7-f7dacaa4bd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.900949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113fa87-10e0-40f4-aea7-f7dacaa4bd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.903026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113fa87-10e0-40f4-aea7-f7dacaa4bd19 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.917020 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.922194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1123/2233] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:18:52.922599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:52.925142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113fa87-10e0-40f4-aea7-f7dacaa4bd19 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:52.938924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c820f-5102-41e4-b370-17a0e7a782d8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.945744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.946472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113fa87-10e0-40f4-aea7-f7dacaa4bd19 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:52.947356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.947851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.948251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] PATH_INFO: `/v3/projects/b4f057ae131e47bea0d8faec3ad37c0a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.949848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f057ae131e47bea0d8faec3ad37c0a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.953588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:52.954508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b00bc-e430-4ed4-b71d-49f38126a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:52.955644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b00bc-e430-4ed4-b71d-49f38126a738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:52.956152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b00bc-e430-4ed4-b71d-49f38126a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:52.956663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b00bc-e430-4ed4-b71d-49f38126a738 admin admin] PATH_INFO: `/v3/projects/f7a2955d84864bbd8d9913e878d6ff10/users/77ca0d6d1d104bf183222a2fb997377b/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:52.982413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b00bc-e430-4ed4-b71d-49f38126a738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a2955d84864bbd8d9913e878d6ff10, user_id=77ca0d6d1d104bf183222a2fb997377b, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:52.985163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b00bc-e430-4ed4-b71d-49f38126a738 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:53.001212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1124/2234] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:52 2022] PUT /identity/v3/projects/f7a2955d84864bbd8d9913e878d6ff10/users/77ca0d6d1d104bf183222a2fb997377b/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:53.016946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef9009-8a9d-40b2-a7d1-c987df3afe1c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.018564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef9009-8a9d-40b2-a7d1-c987df3afe1c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.018564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef9009-8a9d-40b2-a7d1-c987df3afe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:53.023967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:53.049369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f057ae131e47bea0d8faec3ad37c0a', 'request_id': 'req-63ff2264-5c29-4d1e-951d-0b0763034caa'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.055696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:53.059941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f057ae131e47bea0d8faec3ad37c0a', 'request_id': 'req-63ff2264-5c29-4d1e-951d-0b0763034caa'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.071890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f057ae131e47bea0d8faec3ad37c0a', 'request_id': 'req-63ff2264-5c29-4d1e-951d-0b0763034caa'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.075630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5fef9009-8a9d-40b2-a7d1-c987df3afe1c None None] MFA Rules not processed for user `77ca0d6d1d104bf183222a2fb997377b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:53.075630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5fef9009-8a9d-40b2-a7d1-c987df3afe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:53.085794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] The token cache is being invalidate because project b4f057ae131e47bea0d8faec3ad37c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:18:53.087314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.088267 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.089998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1111/2235] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:18:52 2022] DELETE /identity/v3/projects/b4f057ae131e47bea0d8faec3ad37c0a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:53.094910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:53.096823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:53.170085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1125/2236] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:53.183747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef9009-8a9d-40b2-a7d1-c987df3afe1c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:53.185154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5fef9009-8a9d-40b2-a7d1-c987df3afe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:53.187766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff2264-5c29-4d1e-951d-0b0763034caa admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:53.192550 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:53.193189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.193474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.193751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] PATH_INFO: `/v3/users/4349138f18224f8ebc5c96c70b4b5d75` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:53.195673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4349138f18224f8ebc5c96c70b4b5d75)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:53.198442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:53.249613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef9009-8a9d-40b2-a7d1-c987df3afe1c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:53.250615 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4349138f18224f8ebc5c96c70b4b5d75'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.253560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:53.254172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.254479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.254760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:53.258496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4349138f18224f8ebc5c96c70b4b5d75'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.259249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4349138f18224f8ebc5c96c70b4b5d75'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.265043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:53.266912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:53.267854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4349138f18224f8ebc5c96c70b4b5d75'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.278623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1126/2237] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:18:53.283147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ac14cbf2-fdf8-4482-af8e-ee217a83372d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4349138f18224f8ebc5c96c70b4b5d75'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.290016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1112/2238] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:18:53 2022] DELETE /identity/v3/users/4349138f18224f8ebc5c96c70b4b5d75 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:53.305832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:53.307329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:53.321839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded02d4-fb55-4daf-b433-464e8b780578 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:53.390429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:53.391167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.392004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.392357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] PATH_INFO: `/v3/users/77ca0d6d1d104bf183222a2fb997377b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:53.393625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ca0d6d1d104bf183222a2fb997377b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:53.395635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:53.463368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ca0d6d1d104bf183222a2fb997377b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.469374 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:53.490277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ca0d6d1d104bf183222a2fb997377b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.493557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ca0d6d1d104bf183222a2fb997377b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.507877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ca0d6d1d104bf183222a2fb997377b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.508618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ca0d6d1d104bf183222a2fb997377b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.545394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1127/2239] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:18:53 2022] DELETE /identity/v3/users/77ca0d6d1d104bf183222a2fb997377b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:53.550159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baaa3a-eaa1-492a-80e2-58811f63bea2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.550681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baaa3a-eaa1-492a-80e2-58811f63bea2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.550989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baaa3a-eaa1-492a-80e2-58811f63bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:53.572925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c4baaa3a-eaa1-492a-80e2-58811f63bea2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:53.574587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c4baaa3a-eaa1-492a-80e2-58811f63bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:53.626646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:53.626907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:53.629380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:53.721536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1113/2240] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:53.729462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baaa3a-eaa1-492a-80e2-58811f63bea2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:53.731017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c4baaa3a-eaa1-492a-80e2-58811f63bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:53.776090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748430d1-6506-412c-80f3-8b4373b6d984 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:53.788986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:53.789643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.789925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.790720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] PATH_INFO: `/v3/projects/c6736b943ba54e84a15bc802091d6dc8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:53.791882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6736b943ba54e84a15bc802091d6dc8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:53.794671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:53.808536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baaa3a-eaa1-492a-80e2-58811f63bea2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:53.812385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd611202-4239-4238-9dc0-a9df77ce7b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:53.812998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611202-4239-4238-9dc0-a9df77ce7b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.813280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611202-4239-4238-9dc0-a9df77ce7b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.813553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd611202-4239-4238-9dc0-a9df77ce7b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:53.824175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd611202-4239-4238-9dc0-a9df77ce7b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:53.825690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd611202-4239-4238-9dc0-a9df77ce7b68 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:53.836693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1114/2241] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:18:53.852572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6736b943ba54e84a15bc802091d6dc8', 'request_id': 'req-d927da43-2933-47e9-9248-6719a7ab1456'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.859431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6736b943ba54e84a15bc802091d6dc8', 'request_id': 'req-d927da43-2933-47e9-9248-6719a7ab1456'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.865392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6736b943ba54e84a15bc802091d6dc8', 'request_id': 'req-d927da43-2933-47e9-9248-6719a7ab1456'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.882448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] The token cache is being invalidate because project c6736b943ba54e84a15bc802091d6dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:18:53.882817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.883469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d927da43-2933-47e9-9248-6719a7ab1456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:53.885287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1128/2242] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:18:53 2022] DELETE /identity/v3/projects/c6736b943ba54e84a15bc802091d6dc8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:53.889990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714e98-946b-419f-8abc-074cbc0ec68d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.890400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714e98-946b-419f-8abc-074cbc0ec68d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.890690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714e98-946b-419f-8abc-074cbc0ec68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:53.911296 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-de714e98-946b-419f-8abc-074cbc0ec68d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:53.912525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-de714e98-946b-419f-8abc-074cbc0ec68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:53.979865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1115/2243] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:53.990402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21e9e-4bbb-4af1-a9b0-2709f812e624 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:53.990698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21e9e-4bbb-4af1-a9b0-2709f812e624 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:53.990985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21e9e-4bbb-4af1-a9b0-2709f812e624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.018566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a1e21e9e-4bbb-4af1-a9b0-2709f812e624 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:54.019842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a1e21e9e-4bbb-4af1-a9b0-2709f812e624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:54.028200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1129/2244] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:54.032650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de714e98-946b-419f-8abc-074cbc0ec68d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.043572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de714e98-946b-419f-8abc-074cbc0ec68d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.048758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.049387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.049822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.050106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.050796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:18:54.051104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.052730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.066004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1116/2245] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:18:54.071429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e21e9e-4bbb-4af1-a9b0-2709f812e624 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.082209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e21e9e-4bbb-4af1-a9b0-2709f812e624 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.087128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.087746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.088025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.088297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.088931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.090891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.124262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1130/2246] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:54.128614 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.145467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a2479-12e0-4304-8b0c-a551017feda1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.147535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.149514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:54.187095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:54.232375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688bf1-214b-448f-bd46-eb79ac142f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.233172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688bf1-214b-448f-bd46-eb79ac142f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.233554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688bf1-214b-448f-bd46-eb79ac142f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.233935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688bf1-214b-448f-bd46-eb79ac142f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.234791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688bf1-214b-448f-bd46-eb79ac142f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.236847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688bf1-214b-448f-bd46-eb79ac142f8b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.247936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd1178-fe12-4275-92b2-7f13fc04cb5d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.249046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:54.259025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.259939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.260536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.260712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] PATH_INFO: `/v3/projects/f7a2955d84864bbd8d9913e878d6ff10` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.262527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a2955d84864bbd8d9913e878d6ff10)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.264165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.275617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1117/2247] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:54.279896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688bf1-214b-448f-bd46-eb79ac142f8b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.297911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688bf1-214b-448f-bd46-eb79ac142f8b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.304558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f877bf-0897-4a7d-a2c0-b06fc9cea176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.305335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f877bf-0897-4a7d-a2c0-b06fc9cea176 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.305644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f877bf-0897-4a7d-a2c0-b06fc9cea176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.305896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f877bf-0897-4a7d-a2c0-b06fc9cea176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.306608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f877bf-0897-4a7d-a2c0-b06fc9cea176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.308258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f877bf-0897-4a7d-a2c0-b06fc9cea176 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.320932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1118/2248] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:54.323523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a2955d84864bbd8d9913e878d6ff10', 'request_id': 'req-64d9c195-fa73-45bb-a76b-30a370041609'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:54.331751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a2955d84864bbd8d9913e878d6ff10', 'request_id': 'req-64d9c195-fa73-45bb-a76b-30a370041609'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:54.339633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a2955d84864bbd8d9913e878d6ff10', 'request_id': 'req-64d9c195-fa73-45bb-a76b-30a370041609'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:54.342044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f877bf-0897-4a7d-a2c0-b06fc9cea176 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.354418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] The token cache is being invalidate because project f7a2955d84864bbd8d9913e878d6ff10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:18:54.354707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:54.355377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64d9c195-fa73-45bb-a76b-30a370041609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:18:54.356891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1131/2249] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:18:54 2022] DELETE /identity/v3/projects/f7a2955d84864bbd8d9913e878d6ff10 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:54.357369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f877bf-0897-4a7d-a2c0-b06fc9cea176 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.361758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1ce75-3c54-4952-9cf8-4dc57d50f423 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.362046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1ce75-3c54-4952-9cf8-4dc57d50f423 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.362351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1ce75-3c54-4952-9cf8-4dc57d50f423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.385869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-84e1ce75-3c54-4952-9cf8-4dc57d50f423 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:54.387135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-84e1ce75-3c54-4952-9cf8-4dc57d50f423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:54.434781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.435861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.436476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.436870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.437530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.439188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.450998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1119/2250] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:54.457754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.461336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:54.463246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1132/2251] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:54.472025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83612654-e2fd-49f3-84d2-80a928365b23 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.472346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83612654-e2fd-49f3-84d2-80a928365b23 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.473094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83612654-e2fd-49f3-84d2-80a928365b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.481721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f69c0-e839-48bc-b350-a3877b6c97a1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.486691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96935f-2f5c-4081-bd10-113c18ad4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.487469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96935f-2f5c-4081-bd10-113c18ad4604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.487760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96935f-2f5c-4081-bd10-113c18ad4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.488037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96935f-2f5c-4081-bd10-113c18ad4604 admin admin] PATH_INFO: `/v3/projects/565ad7561cf44e168638fbca46576eec/users/6aa889f666ef4ab4a143847b375f8a51/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.498275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-83612654-e2fd-49f3-84d2-80a928365b23 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:54.499517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-83612654-e2fd-49f3-84d2-80a928365b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:54.504371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96935f-2f5c-4081-bd10-113c18ad4604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565ad7561cf44e168638fbca46576eec, user_id=6aa889f666ef4ab4a143847b375f8a51, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.508179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96935f-2f5c-4081-bd10-113c18ad4604 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.508695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1133/2252] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:18:54.513251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83612654-e2fd-49f3-84d2-80a928365b23 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.523478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83612654-e2fd-49f3-84d2-80a928365b23 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.527681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1120/2253] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:54 2022] PUT /identity/v3/projects/565ad7561cf44e168638fbca46576eec/users/6aa889f666ef4ab4a143847b375f8a51/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:54.539788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad156b-44f5-4583-bd42-93e7d6bdddaa None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.540533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad156b-44f5-4583-bd42-93e7d6bdddaa None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.540976 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad156b-44f5-4583-bd42-93e7d6bdddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.573897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-34ad156b-44f5-4583-bd42-93e7d6bdddaa None None] MFA Rules not processed for user `6aa889f666ef4ab4a143847b375f8a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:54.575529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:54.575670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-34ad156b-44f5-4583-bd42-93e7d6bdddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:54.598082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.598891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.599177 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.599689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.600370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:18:54.600715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.603052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.630153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1134/2254] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:18:54.631486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.644485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a8e3-f23e-4272-a4ba-bafbda2864f0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.650304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720383-e1ca-4f79-b47d-fb06de03335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.650936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720383-e1ca-4f79-b47d-fb06de03335c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.651224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720383-e1ca-4f79-b47d-fb06de03335c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.651501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720383-e1ca-4f79-b47d-fb06de03335c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.652150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da720383-e1ca-4f79-b47d-fb06de03335c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.654106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da720383-e1ca-4f79-b47d-fb06de03335c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.683181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1121/2255] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:54.687339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad156b-44f5-4583-bd42-93e7d6bdddaa None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.688836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1135/2256] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/projects => generated 397 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:54.692841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720383-e1ca-4f79-b47d-fb06de03335c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.701647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad156b-44f5-4583-bd42-93e7d6bdddaa None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.746073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:54.755901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720383-e1ca-4f79-b47d-fb06de03335c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.761710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df01d-24a9-47fa-863f-0a999e153da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.762511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df01d-24a9-47fa-863f-0a999e153da9 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.762803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df01d-24a9-47fa-863f-0a999e153da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.763077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2df01d-24a9-47fa-863f-0a999e153da9 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.763711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2df01d-24a9-47fa-863f-0a999e153da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.764385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8353d1-e15f-449d-827a-ba655fec6921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.765028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8353d1-e15f-449d-827a-ba655fec6921 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.765315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8353d1-e15f-449d-827a-ba655fec6921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.765594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8353d1-e15f-449d-827a-ba655fec6921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.765696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2df01d-24a9-47fa-863f-0a999e153da9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.766234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8353d1-e15f-449d-827a-ba655fec6921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.771091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8353d1-e15f-449d-827a-ba655fec6921 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.792406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1136/2257] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:54.807126 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1122/2258] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:18:54.809111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df01d-24a9-47fa-863f-0a999e153da9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.813721 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8353d1-e15f-449d-827a-ba655fec6921 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.831355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2df01d-24a9-47fa-863f-0a999e153da9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.911755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8353d1-e15f-449d-827a-ba655fec6921 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.930918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b445f-af8b-4a3e-bc60-22a3c1a21479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.931591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b445f-af8b-4a3e-bc60-22a3c1a21479 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.931872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b445f-af8b-4a3e-bc60-22a3c1a21479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.933048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b445f-af8b-4a3e-bc60-22a3c1a21479 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.935154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b445f-af8b-4a3e-bc60-22a3c1a21479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.938369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b445f-af8b-4a3e-bc60-22a3c1a21479 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.958054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4328b-588d-44bb-ad75-a681f2bab98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.958878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4328b-588d-44bb-ad75-a681f2bab98e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.959156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4328b-588d-44bb-ad75-a681f2bab98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.959468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4328b-588d-44bb-ad75-a681f2bab98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.961670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4328b-588d-44bb-ad75-a681f2bab98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:54.964043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4328b-588d-44bb-ad75-a681f2bab98e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:54.976550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1137/2259] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:18:54.980983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4328b-588d-44bb-ad75-a681f2bab98e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:54.992044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4328b-588d-44bb-ad75-a681f2bab98e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:54.995330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1123/2260] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:18:54 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:54.997451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e29be-2bd5-451e-9df1-4b94890445f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:54.998250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e29be-2bd5-451e-9df1-4b94890445f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:54.998452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e29be-2bd5-451e-9df1-4b94890445f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:54.998842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e29be-2bd5-451e-9df1-4b94890445f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:54.999568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e29be-2bd5-451e-9df1-4b94890445f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.000146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b445f-af8b-4a3e-bc60-22a3c1a21479 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.001456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e29be-2bd5-451e-9df1-4b94890445f5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.011510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b445f-af8b-4a3e-bc60-22a3c1a21479 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.013743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1138/2261] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:55.017154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d6bd6-8a3f-40de-9e65-df677deb626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.017637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d6bd6-8a3f-40de-9e65-df677deb626b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.017938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d6bd6-8a3f-40de-9e65-df677deb626b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.018339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d6bd6-8a3f-40de-9e65-df677deb626b admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.018880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d6bd6-8a3f-40de-9e65-df677deb626b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.020518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d6bd6-8a3f-40de-9e65-df677deb626b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.028352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e29be-2bd5-451e-9df1-4b94890445f5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.032952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1124/2262] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:18:55.036958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d6bd6-8a3f-40de-9e65-df677deb626b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.040140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e29be-2bd5-451e-9df1-4b94890445f5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.044964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900464f1-93dc-4320-a520-f9dc3bea2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.045853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900464f1-93dc-4320-a520-f9dc3bea2fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.046156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900464f1-93dc-4320-a520-f9dc3bea2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.046495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900464f1-93dc-4320-a520-f9dc3bea2fe8 admin admin] PATH_INFO: `/v3/projects/b0d414a389634e14878db551d06ba188/users/6afc8e10efec4dc9aaa949accd5f4046/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.053014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d6bd6-8a3f-40de-9e65-df677deb626b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.058842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f9359-8e09-47ca-8a20-988bbe3328ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.059462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f9359-8e09-47ca-8a20-988bbe3328ba admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.059747 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f9359-8e09-47ca-8a20-988bbe3328ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.060037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f9359-8e09-47ca-8a20-988bbe3328ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.060780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f9359-8e09-47ca-8a20-988bbe3328ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.062711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f9359-8e09-47ca-8a20-988bbe3328ba admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.069767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900464f1-93dc-4320-a520-f9dc3bea2fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d414a389634e14878db551d06ba188, user_id=6afc8e10efec4dc9aaa949accd5f4046, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.072620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900464f1-93dc-4320-a520-f9dc3bea2fe8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.078293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1125/2263] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:18:55.083917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f9359-8e09-47ca-8a20-988bbe3328ba admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.088303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1139/2264] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:55 2022] PUT /identity/v3/projects/b0d414a389634e14878db551d06ba188/users/6afc8e10efec4dc9aaa949accd5f4046/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:55.096593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f9359-8e09-47ca-8a20-988bbe3328ba admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.099963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145f11-e717-49a6-bbcd-3e84726c2de3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.100301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145f11-e717-49a6-bbcd-3e84726c2de3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.101154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145f11-e717-49a6-bbcd-3e84726c2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.136406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:55.146201 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f8145f11-e717-49a6-bbcd-3e84726c2de3 None None] MFA Rules not processed for user `6afc8e10efec4dc9aaa949accd5f4046`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:55.148406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f8145f11-e717-49a6-bbcd-3e84726c2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:55.185939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.186650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.186935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.187209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] PATH_INFO: `/v3/projects/abc89c47db864e87b46b09a581468e5f/users/56ff7785968e4f229902b5c44255a7f1/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.210818 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc89c47db864e87b46b09a581468e5f, user_id=56ff7785968e4f229902b5c44255a7f1, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.216261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.237102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1140/2265] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:55.250850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1126/2266] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:55 2022] PUT /identity/v3/projects/abc89c47db864e87b46b09a581468e5f/users/56ff7785968e4f229902b5c44255a7f1/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:18:55.252875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbe8b-2379-4595-8b50-e2473dcd6740 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.253351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbe8b-2379-4595-8b50-e2473dcd6740 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.253636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbe8b-2379-4595-8b50-e2473dcd6740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.256491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.259079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:55.295000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:55.295489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-84dfbe8b-2379-4595-8b50-e2473dcd6740 None None] MFA Rules not processed for user `56ff7785968e4f229902b5c44255a7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:55.296742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-84dfbe8b-2379-4595-8b50-e2473dcd6740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:55.349118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fef2b-ebd8-4538-9c7f-24a6ea35d71d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.354859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702e72d-c938-4e05-a3e6-99206665b33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.355504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702e72d-c938-4e05-a3e6-99206665b33f service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.356232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702e72d-c938-4e05-a3e6-99206665b33f service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.356662 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702e72d-c938-4e05-a3e6-99206665b33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.401089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1141/2267] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:55.402524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfbe8b-2379-4595-8b50-e2473dcd6740 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.448200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702e72d-c938-4e05-a3e6-99206665b33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.449653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702e72d-c938-4e05-a3e6-99206665b33f service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.458888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1127/2268] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:18:55.482489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfbe8b-2379-4595-8b50-e2473dcd6740 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.489572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d8589-6dad-43e6-9d57-03a1fae2a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.490245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8589-6dad-43e6-9d57-03a1fae2a6ac admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.490647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8589-6dad-43e6-9d57-03a1fae2a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.490925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8589-6dad-43e6-9d57-03a1fae2a6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.492209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d8589-6dad-43e6-9d57-03a1fae2a6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.494296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d8589-6dad-43e6-9d57-03a1fae2a6ac admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.523237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1142/2269] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:18:55 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:18:55.527271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702e72d-c938-4e05-a3e6-99206665b33f service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.539259 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702e72d-c938-4e05-a3e6-99206665b33f service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.604523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d771aa-286e-4233-a3f7-80b7db1b3b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.605148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d771aa-286e-4233-a3f7-80b7db1b3b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.605443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d771aa-286e-4233-a3f7-80b7db1b3b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.605724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d771aa-286e-4233-a3f7-80b7db1b3b75 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.606408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d771aa-286e-4233-a3f7-80b7db1b3b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.608591 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d771aa-286e-4233-a3f7-80b7db1b3b75 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.639382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1128/2270] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:18:55 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:18:55.640564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d8589-6dad-43e6-9d57-03a1fae2a6ac admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.651055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d8589-6dad-43e6-9d57-03a1fae2a6ac admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.655749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ba02-4fb6-466c-b8e9-b496ea816881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.656359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ba02-4fb6-466c-b8e9-b496ea816881 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.656641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ba02-4fb6-466c-b8e9-b496ea816881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.656920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ba02-4fb6-466c-b8e9-b496ea816881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.657563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ba02-4fb6-466c-b8e9-b496ea816881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.659589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8ba02-4fb6-466c-b8e9-b496ea816881 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.811457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1143/2271] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:55.815532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d771aa-286e-4233-a3f7-80b7db1b3b75 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.835813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d771aa-286e-4233-a3f7-80b7db1b3b75 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.841429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276810db-2ead-408e-af64-dcb106437ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.842094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276810db-2ead-408e-af64-dcb106437ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.843313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276810db-2ead-408e-af64-dcb106437ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.843313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276810db-2ead-408e-af64-dcb106437ab6 admin admin] PATH_INFO: `/v3/projects/d4cf815dbf0d43ada2d8fe9f3bc1ad70/users/5b119a4856364fae97d1accb44f2dec1/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.862231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276810db-2ead-408e-af64-dcb106437ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4cf815dbf0d43ada2d8fe9f3bc1ad70, user_id=5b119a4856364fae97d1accb44f2dec1, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.864950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276810db-2ead-408e-af64-dcb106437ab6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:55.884859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1129/2272] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:55 2022] PUT /identity/v3/projects/d4cf815dbf0d43ada2d8fe9f3bc1ad70/users/5b119a4856364fae97d1accb44f2dec1/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:55.888750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ba02-4fb6-466c-b8e9-b496ea816881 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:55.900304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:55.906091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ba02-4fb6-466c-b8e9-b496ea816881 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:55.995662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ca24d-56c8-4f8b-bb5a-d8ac48036145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:55.996286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca24d-56c8-4f8b-bb5a-d8ac48036145 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:55.996571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca24d-56c8-4f8b-bb5a-d8ac48036145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:55.997155 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ca24d-56c8-4f8b-bb5a-d8ac48036145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:55.997865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca24d-56c8-4f8b-bb5a-d8ac48036145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:55.999579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ca24d-56c8-4f8b-bb5a-d8ac48036145 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:56.017805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276810db-2ead-408e-af64-dcb106437ab6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:56.022418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1144/2273] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:18:56.031942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276810db-2ead-408e-af64-dcb106437ab6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:56.037236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:56.039152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:56.039515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:56.039867 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] PATH_INFO: `/v3/projects/d4cf815dbf0d43ada2d8fe9f3bc1ad70/users/5b119a4856364fae97d1accb44f2dec1/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:56.053277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4cf815dbf0d43ada2d8fe9f3bc1ad70, user_id=5b119a4856364fae97d1accb44f2dec1, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:56.056470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:56.082162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1130/2274] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:18:56 2022] PUT /identity/v3/projects/d4cf815dbf0d43ada2d8fe9f3bc1ad70/users/5b119a4856364fae97d1accb44f2dec1/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:18:56.083500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449e1c2-e240-4888-9d5b-1106a83756d7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:56.084314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449e1c2-e240-4888-9d5b-1106a83756d7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:56.084594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449e1c2-e240-4888-9d5b-1106a83756d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:56.121848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1449e1c2-e240-4888-9d5b-1106a83756d7 None None] MFA Rules not processed for user `5b119a4856364fae97d1accb44f2dec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:18:56.123208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1449e1c2-e240-4888-9d5b-1106a83756d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:56.193618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1145/2275] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:18:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:18:56.206047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:18:56.207770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:18:56.241941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:18:56.273984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559fdd0-0534-45ce-9d24-9e6426a8a1c1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:18:56.277735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a814e1-3d5f-40b6-b1a5-ee6964e7cb2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:18:56.278485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a814e1-3d5f-40b6-b1a5-ee6964e7cb2a service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:18:56.279088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a814e1-3d5f-40b6-b1a5-ee6964e7cb2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:18:56.279307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a814e1-3d5f-40b6-b1a5-ee6964e7cb2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:18:56.342448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a814e1-3d5f-40b6-b1a5-ee6964e7cb2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:18:56.344198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a814e1-3d5f-40b6-b1a5-ee6964e7cb2a service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:18:56.353641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1131/2276] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:18:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:01.125737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449e1c2-e240-4888-9d5b-1106a83756d7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:01.135624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449e1c2-e240-4888-9d5b-1106a83756d7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:01.139479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01c6c-2b97-492e-a0f8-0af33f5be8c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:01.140121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01c6c-2b97-492e-a0f8-0af33f5be8c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:01.140400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01c6c-2b97-492e-a0f8-0af33f5be8c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:01.140675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01c6c-2b97-492e-a0f8-0af33f5be8c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:01.199274 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01c6c-2b97-492e-a0f8-0af33f5be8c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:01.200618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01c6c-2b97-492e-a0f8-0af33f5be8c5 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:01.209836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1146/2277] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:03.582761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a814e1-3d5f-40b6-b1a5-ee6964e7cb2a service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:03.592999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a814e1-3d5f-40b6-b1a5-ee6964e7cb2a service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:03.597290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db7efb-e266-4da0-91cc-4284d2d3b4b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:03.597893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db7efb-e266-4da0-91cc-4284d2d3b4b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:03.598170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db7efb-e266-4da0-91cc-4284d2d3b4b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:03.598495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db7efb-e266-4da0-91cc-4284d2d3b4b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:03.609189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db7efb-e266-4da0-91cc-4284d2d3b4b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:03.610928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db7efb-e266-4da0-91cc-4284d2d3b4b7 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:03.623968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1132/2278] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:09.051223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01c6c-2b97-492e-a0f8-0af33f5be8c5 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:09.081817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:09.125459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01c6c-2b97-492e-a0f8-0af33f5be8c5 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:09.130140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:09.130852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:09.131128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:09.132047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] PATH_INFO: `/v3/users/6afc8e10efec4dc9aaa949accd5f4046` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:09.133243 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afc8e10efec4dc9aaa949accd5f4046)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:09.135235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:09.189511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afc8e10efec4dc9aaa949accd5f4046'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.197195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afc8e10efec4dc9aaa949accd5f4046'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.197854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afc8e10efec4dc9aaa949accd5f4046'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.205340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afc8e10efec4dc9aaa949accd5f4046'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.206024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afc8e10efec4dc9aaa949accd5f4046'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.223871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1147/2279] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:19:09 2022] DELETE /identity/v3/users/6afc8e10efec4dc9aaa949accd5f4046 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:09.229240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc520060-9f95-4c61-963c-299c0697dbd7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:09.229793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc520060-9f95-4c61-963c-299c0697dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:09.229793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc520060-9f95-4c61-963c-299c0697dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:09.249934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-bc520060-9f95-4c61-963c-299c0697dbd7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:09.251169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bc520060-9f95-4c61-963c-299c0697dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:09.309978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1133/2280] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:19:09.320181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:09.321578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:09.380511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af5c3-cca3-4c96-9ee4-fcf41cb91eb2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:09.384739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:09.385347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:09.385632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:09.385904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:09.395365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:09.396852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:09.407675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1148/2281] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:09.692236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc520060-9f95-4c61-963c-299c0697dbd7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:09.694613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-bc520060-9f95-4c61-963c-299c0697dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:09.707602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc520060-9f95-4c61-963c-299c0697dbd7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:09.714388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:09.715527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:09.716062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:09.716437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] PATH_INFO: `/v3/users/6aa889f666ef4ab4a143847b375f8a51` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:09.718191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa889f666ef4ab4a143847b375f8a51)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:09.720834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:09.776060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:09.777732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:09.780546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa889f666ef4ab4a143847b375f8a51'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.794100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414df484-97dc-4be7-bd83-013329dd4174 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:09.794391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa889f666ef4ab4a143847b375f8a51'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.795311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa889f666ef4ab4a143847b375f8a51'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.800260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:09.802295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:09.802295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:09.802295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] PATH_INFO: `/v3/projects/b0d414a389634e14878db551d06ba188` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:09.802667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d414a389634e14878db551d06ba188)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:09.805126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:09.815764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa889f666ef4ab4a143847b375f8a51'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.819902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:09.838468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-033e4535-bb0c-42fa-8af7-f893de925b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa889f666ef4ab4a143847b375f8a51'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.847160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1134/2282] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:19:09 2022] DELETE /identity/v3/users/6aa889f666ef4ab4a143847b375f8a51 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:09.851658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e7dc5-438d-48e5-a096-f0f6f15f930f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:09.852223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e7dc5-438d-48e5-a096-f0f6f15f930f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:09.852567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e7dc5-438d-48e5-a096-f0f6f15f930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:09.856469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:09.868963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d414a389634e14878db551d06ba188', 'request_id': 'req-5d56e11e-ee86-429f-8633-6fddac5b0238'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.877411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c46e7dc5-438d-48e5-a096-f0f6f15f930f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:09.878701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c46e7dc5-438d-48e5-a096-f0f6f15f930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:09.885173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d414a389634e14878db551d06ba188', 'request_id': 'req-5d56e11e-ee86-429f-8633-6fddac5b0238'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.895348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d414a389634e14878db551d06ba188', 'request_id': 'req-5d56e11e-ee86-429f-8633-6fddac5b0238'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.918761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] The token cache is being invalidate because project b0d414a389634e14878db551d06ba188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:19:09.919350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.920462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5d56e11e-ee86-429f-8633-6fddac5b0238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:09.923182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1149/2283] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:19:09 2022] DELETE /identity/v3/projects/b0d414a389634e14878db551d06ba188 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:19:09.931549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e258e-6ffa-4153-9b20-7053048b82d5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:09.932114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e258e-6ffa-4153-9b20-7053048b82d5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:09.932640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e258e-6ffa-4153-9b20-7053048b82d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:09.965275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d70e258e-6ffa-4153-9b20-7053048b82d5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:09.967697 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d70e258e-6ffa-4153-9b20-7053048b82d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:09.986440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1135/2284] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:19:10.003333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e7dc5-438d-48e5-a096-f0f6f15f930f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.007564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c46e7dc5-438d-48e5-a096-f0f6f15f930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:10.071812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1150/2285] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:19:10.079664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd62a3-51e7-4f9f-b26a-e73bba1ea392 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.079951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd62a3-51e7-4f9f-b26a-e73bba1ea392 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.080240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd62a3-51e7-4f9f-b26a-e73bba1ea392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.103928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e7dc5-438d-48e5-a096-f0f6f15f930f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.104340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-85cd62a3-51e7-4f9f-b26a-e73bba1ea392 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:10.105964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-85cd62a3-51e7-4f9f-b26a-e73bba1ea392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:10.108506 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0abd4f-2bc2-4eaa-bd12-0424f250e9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.109279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abd4f-2bc2-4eaa-bd12-0424f250e9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.109593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abd4f-2bc2-4eaa-bd12-0424f250e9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.109808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abd4f-2bc2-4eaa-bd12-0424f250e9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.118613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1151/2286] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:19:10.119738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd62a3-51e7-4f9f-b26a-e73bba1ea392 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.123493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0abd4f-2bc2-4eaa-bd12-0424f250e9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.124946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0abd4f-2bc2-4eaa-bd12-0424f250e9e0 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.131366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd62a3-51e7-4f9f-b26a-e73bba1ea392 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.135633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1136/2287] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:10.136968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.137737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.138112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.138477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.139195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:19:10.139570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.141281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.155012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1152/2288] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:19:10.159271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0abd4f-2bc2-4eaa-bd12-0424f250e9e0 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.173330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0abd4f-2bc2-4eaa-bd12-0424f250e9e0 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.182949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe4a82-2af1-4ef4-8211-eb3905a6fabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.183911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4a82-2af1-4ef4-8211-eb3905a6fabb admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.186279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4a82-2af1-4ef4-8211-eb3905a6fabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.186279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4a82-2af1-4ef4-8211-eb3905a6fabb admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.186279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe4a82-2af1-4ef4-8211-eb3905a6fabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.190052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe4a82-2af1-4ef4-8211-eb3905a6fabb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.259968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1137/2289] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:19:10 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:19:10.263986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.276939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d27c-6daf-4002-822f-7dcedfbd5d71 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.381084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73111a-c335-441a-876b-870d9d25c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.382628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73111a-c335-441a-876b-870d9d25c1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.382805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73111a-c335-441a-876b-870d9d25c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.383022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73111a-c335-441a-876b-870d9d25c1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.383667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73111a-c335-441a-876b-870d9d25c1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.385610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73111a-c335-441a-876b-870d9d25c1f0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.410299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1153/2290] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:19:10 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:19:10.411786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe4a82-2af1-4ef4-8211-eb3905a6fabb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.422332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe4a82-2af1-4ef4-8211-eb3905a6fabb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.427289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b14559-c9ee-40b2-88d9-2aa5ad8fa3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.427952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b14559-c9ee-40b2-88d9-2aa5ad8fa3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.428909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b14559-c9ee-40b2-88d9-2aa5ad8fa3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.429196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b14559-c9ee-40b2-88d9-2aa5ad8fa3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.429946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b14559-c9ee-40b2-88d9-2aa5ad8fa3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.431582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b14559-c9ee-40b2-88d9-2aa5ad8fa3d9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.445853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1138/2291] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:19:10.447099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73111a-c335-441a-876b-870d9d25c1f0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.458507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73111a-c335-441a-876b-870d9d25c1f0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.464179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.464793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.465071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.465347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.465996 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.467895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.481747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1154/2292] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:19:10.486185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b14559-c9ee-40b2-88d9-2aa5ad8fa3d9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.496870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b14559-c9ee-40b2-88d9-2aa5ad8fa3d9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.502244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6aa3f-cff4-4e7a-a8be-75a264e5b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.503037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6aa3f-cff4-4e7a-a8be-75a264e5b353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.503326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6aa3f-cff4-4e7a-a8be-75a264e5b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.503598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6aa3f-cff4-4e7a-a8be-75a264e5b353 admin admin] PATH_INFO: `/v3/projects/f4336b9623424da8982f8a56ddee5a7a/users/bd69ef83d23d49fcbedcd308b1edf957/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.512082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.514059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:10.523176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6aa3f-cff4-4e7a-a8be-75a264e5b353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4336b9623424da8982f8a56ddee5a7a, user_id=bd69ef83d23d49fcbedcd308b1edf957, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.525933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6aa3f-cff4-4e7a-a8be-75a264e5b353 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.532142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123addda-52cb-4df1-8643-488f9dbfce47 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.548537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.549198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.549480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.549851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] PATH_INFO: `/v3/projects/565ad7561cf44e168638fbca46576eec` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.550921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=565ad7561cf44e168638fbca46576eec)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.552842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.554807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1139/2293] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:19:10 2022] PUT /identity/v3/projects/f4336b9623424da8982f8a56ddee5a7a/users/bd69ef83d23d49fcbedcd308b1edf957/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:19:10.559556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef558e-fe7d-4b98-934e-e577f8e0d222 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.559927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef558e-fe7d-4b98-934e-e577f8e0d222 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.560335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef558e-fe7d-4b98-934e-e577f8e0d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.579927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c2ef558e-fe7d-4b98-934e-e577f8e0d222 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:10.581208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c2ef558e-fe7d-4b98-934e-e577f8e0d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:10.583838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:10.605996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:10.617057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565ad7561cf44e168638fbca46576eec', 'request_id': 'req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.630987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565ad7561cf44e168638fbca46576eec', 'request_id': 'req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.639825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565ad7561cf44e168638fbca46576eec', 'request_id': 'req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.653114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] The token cache is being invalidate because project 565ad7561cf44e168638fbca46576eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:19:10.653516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.654205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.654521 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1140/2294] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:19:10.656183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1155/2295] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:19:10 2022] DELETE /identity/v3/projects/565ad7561cf44e168638fbca46576eec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:19:10.660126 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef558e-fe7d-4b98-934e-e577f8e0d222 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.664623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:10.668001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:10.671170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef558e-fe7d-4b98-934e-e577f8e0d222 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.751933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.752571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.752853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.753127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] PATH_INFO: `/v3/users/56ff7785968e4f229902b5c44255a7f1` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.754288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ff7785968e4f229902b5c44255a7f1)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.756616 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.768931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2513e1-a87e-411a-b98f-ff24b0b4e7cf admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:10.775300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:10.782504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:10.783394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:10.783825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:10.786450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:10.805091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:10.807054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:10.820059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1156/2296] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:19:10.826218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ff7785968e4f229902b5c44255a7f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.833260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ff7785968e4f229902b5c44255a7f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.833984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ff7785968e4f229902b5c44255a7f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.843079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ff7785968e4f229902b5c44255a7f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.856771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ff7785968e4f229902b5c44255a7f1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:10.863253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1141/2297] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:19:10 2022] DELETE /identity/v3/users/56ff7785968e4f229902b5c44255a7f1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:19:11.191246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:11.192819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:11.220485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d60a66-3bf3-4840-ba3c-f8948699dfc2 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:11.300354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:11.301260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:11.301716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:11.302199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] PATH_INFO: `/v3/projects/abc89c47db864e87b46b09a581468e5f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:11.304596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc89c47db864e87b46b09a581468e5f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:11.307088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:11.374418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc89c47db864e87b46b09a581468e5f', 'request_id': 'req-4d9a9397-5953-4d40-b878-45430883d24b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.382715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc89c47db864e87b46b09a581468e5f', 'request_id': 'req-4d9a9397-5953-4d40-b878-45430883d24b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.385657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:11.391154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc89c47db864e87b46b09a581468e5f', 'request_id': 'req-4d9a9397-5953-4d40-b878-45430883d24b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.413536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] The token cache is being invalidate because project abc89c47db864e87b46b09a581468e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:19:11.414044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.415172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.417212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1157/2298] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:19:11 2022] DELETE /identity/v3/projects/abc89c47db864e87b46b09a581468e5f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:11.421941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:11.423512 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:11.437504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe037c5-05d7-4b98-9a24-6276eb56be0c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:11.491309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:11.508281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:11.508947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:11.509235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:11.509513 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] PATH_INFO: `/v3/users/5b119a4856364fae97d1accb44f2dec1` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:11.510731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b119a4856364fae97d1accb44f2dec1)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:11.512975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:11.597606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b119a4856364fae97d1accb44f2dec1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.608577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b119a4856364fae97d1accb44f2dec1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.609350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b119a4856364fae97d1accb44f2dec1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.618210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b119a4856364fae97d1accb44f2dec1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.635253 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b119a4856364fae97d1accb44f2dec1'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:11.642305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1142/2299] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:19:11 2022] DELETE /identity/v3/users/5b119a4856364fae97d1accb44f2dec1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:12.005646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:12.007285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:12.035465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9397-5953-4d40-b878-45430883d24b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:12.141090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:12.141737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:12.142453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:12.142453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] PATH_INFO: `/v3/projects/d4cf815dbf0d43ada2d8fe9f3bc1ad70` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:12.144011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4cf815dbf0d43ada2d8fe9f3bc1ad70)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:12.147397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:12.228294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4cf815dbf0d43ada2d8fe9f3bc1ad70', 'request_id': 'req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:12.237911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4cf815dbf0d43ada2d8fe9f3bc1ad70', 'request_id': 'req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:12.247677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4cf815dbf0d43ada2d8fe9f3bc1ad70', 'request_id': 'req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:12.269485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] The token cache is being invalidate because project d4cf815dbf0d43ada2d8fe9f3bc1ad70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:19:12.269906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:12.270845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-789e963c-58ed-484e-9bf3-e6cf8dae4e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:12.274148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1158/2300] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:19:12 2022] DELETE /identity/v3/projects/d4cf815dbf0d43ada2d8fe9f3bc1ad70 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:13.469001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:13.470537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:13.484842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1d2ba-eba0-4d66-9e16-2ff931e6df0f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:13.555274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:13.556208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:13.556498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:13.556780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] PATH_INFO: `/v3/users/a525c6078be343e1821a449bdd26c745` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:13.557995 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a525c6078be343e1821a449bdd26c745)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:13.559985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:13.622024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a525c6078be343e1821a449bdd26c745'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:13.631473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a525c6078be343e1821a449bdd26c745'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:13.632276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a525c6078be343e1821a449bdd26c745'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:13.643518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a525c6078be343e1821a449bdd26c745'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:13.652243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:13.663280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a525c6078be343e1821a449bdd26c745'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:13.670935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1143/2301] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:19:13 2022] DELETE /identity/v3/users/a525c6078be343e1821a449bdd26c745 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:13.675576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf206-c0b1-4803-8027-569b0888ce99 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:13.676116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf206-c0b1-4803-8027-569b0888ce99 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:13.676116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf206-c0b1-4803-8027-569b0888ce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:13.705976 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0b1bf206-c0b1-4803-8027-569b0888ce99 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:13.707281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0b1bf206-c0b1-4803-8027-569b0888ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:13.788257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1159/2302] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:19:13.802583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:13.810909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:13.915336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a4f92-9ecb-4640-9131-3549282e9ad3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:13.922354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f39c-9bd6-4819-b447-ec3ed3cb8a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:13.923178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f39c-9bd6-4819-b447-ec3ed3cb8a79 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:13.923631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f39c-9bd6-4819-b447-ec3ed3cb8a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:13.924057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f39c-9bd6-4819-b447-ec3ed3cb8a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:13.938017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f39c-9bd6-4819-b447-ec3ed3cb8a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:13.939799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f39c-9bd6-4819-b447-ec3ed3cb8a79 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:13.952580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1144/2303] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:14.580062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bf206-c0b1-4803-8027-569b0888ce99 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:14.581810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0b1bf206-c0b1-4803-8027-569b0888ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:14.606701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bf206-c0b1-4803-8027-569b0888ce99 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:14.618485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:14.619445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:14.619878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:14.620321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] PATH_INFO: `/v3/projects/2411531ea1ad40a6a4d164686fefed1a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:14.621687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2411531ea1ad40a6a4d164686fefed1a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:14.624212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:14.639575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:14.700364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2411531ea1ad40a6a4d164686fefed1a', 'request_id': 'req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:14.715977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2411531ea1ad40a6a4d164686fefed1a', 'request_id': 'req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:14.726739 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2411531ea1ad40a6a4d164686fefed1a', 'request_id': 'req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:14.742608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] The token cache is being invalidate because project 2411531ea1ad40a6a4d164686fefed1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:19:14.742900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:14.743580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8bb0c990-fd3f-40ed-9cbe-2c27ab544aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:14.745319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1160/2304] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:19:14 2022] DELETE /identity/v3/projects/2411531ea1ad40a6a4d164686fefed1a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:14.750516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427288a3-9622-4a94-8e88-b38b08c15757 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:14.751058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427288a3-9622-4a94-8e88-b38b08c15757 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:14.751058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427288a3-9622-4a94-8e88-b38b08c15757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:14.774425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-427288a3-9622-4a94-8e88-b38b08c15757 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:14.775691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-427288a3-9622-4a94-8e88-b38b08c15757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:14.849095 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1145/2305] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:19:14.859322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9060-7168-4989-9c16-1ab9a453ee9d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:14.859322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9060-7168-4989-9c16-1ab9a453ee9d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:14.859769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9060-7168-4989-9c16-1ab9a453ee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:14.884726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-127c9060-7168-4989-9c16-1ab9a453ee9d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:14.885951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-127c9060-7168-4989-9c16-1ab9a453ee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:14.902670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1161/2306] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:19:14.903647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427288a3-9622-4a94-8e88-b38b08c15757 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:14.916132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427288a3-9622-4a94-8e88-b38b08c15757 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:14.922643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:14.923723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:14.924084 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:14.924424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:14.925158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:19:14.925612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:14.927791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:14.954176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1146/2307] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:19:14.958987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c9060-7168-4989-9c16-1ab9a453ee9d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:14.975901 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c9060-7168-4989-9c16-1ab9a453ee9d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:14.984424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cefc2d-eef1-43cb-ad10-c4212dd4a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:14.985118 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cefc2d-eef1-43cb-ad10-c4212dd4a46d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:14.986351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cefc2d-eef1-43cb-ad10-c4212dd4a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:14.986742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cefc2d-eef1-43cb-ad10-c4212dd4a46d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:14.987458 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cefc2d-eef1-43cb-ad10-c4212dd4a46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:14.989450 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cefc2d-eef1-43cb-ad10-c4212dd4a46d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:15.043620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1162/2308] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:19:14 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:19:15.044820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:15.087193 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4400d03-dd46-46e8-951d-24da52eebe14 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:15.200376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec6c71-5bcc-445d-96ef-942c73b22a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:15.201211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6c71-5bcc-445d-96ef-942c73b22a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:15.202182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6c71-5bcc-445d-96ef-942c73b22a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:15.203301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec6c71-5bcc-445d-96ef-942c73b22a7b admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:15.204534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec6c71-5bcc-445d-96ef-942c73b22a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:15.211514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec6c71-5bcc-445d-96ef-942c73b22a7b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:15.263408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1147/2309] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:19:15 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:19:15.270571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cefc2d-eef1-43cb-ad10-c4212dd4a46d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:15.296500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cefc2d-eef1-43cb-ad10-c4212dd4a46d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:15.304946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c24b-d6c1-49bb-8328-893e97970670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:15.304946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c24b-d6c1-49bb-8328-893e97970670 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:15.304946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c24b-d6c1-49bb-8328-893e97970670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:15.304946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84c24b-d6c1-49bb-8328-893e97970670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:15.305609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84c24b-d6c1-49bb-8328-893e97970670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:15.307180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84c24b-d6c1-49bb-8328-893e97970670 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:15.321406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1163/2310] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:19:15.325592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec6c71-5bcc-445d-96ef-942c73b22a7b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:15.334945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:15.341235 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec6c71-5bcc-445d-96ef-942c73b22a7b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:15.351722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8c0b6-f025-46a2-a97a-1608f86e4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:15.353263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8c0b6-f025-46a2-a97a-1608f86e4ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:15.353629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8c0b6-f025-46a2-a97a-1608f86e4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:15.353922 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8c0b6-f025-46a2-a97a-1608f86e4ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:15.355090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8c0b6-f025-46a2-a97a-1608f86e4ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:15.356728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8c0b6-f025-46a2-a97a-1608f86e4ce0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:15.379844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1148/2311] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:19:15.381468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c24b-d6c1-49bb-8328-893e97970670 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:15.394232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84c24b-d6c1-49bb-8328-893e97970670 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:15.403234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:15.403940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:15.404233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:15.404537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] PATH_INFO: `/v3/projects/0bdc9df7037e4f74b2541715b64e7708/users/44e04e25ab764364989f9e3eb841ac0a/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:15.431320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdc9df7037e4f74b2541715b64e7708, user_id=44e04e25ab764364989f9e3eb841ac0a, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:15.434551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:15.459907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1164/2312] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:19:15 2022] PUT /identity/v3/projects/0bdc9df7037e4f74b2541715b64e7708/users/44e04e25ab764364989f9e3eb841ac0a/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:15.477905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577111-a19e-4f2d-85f0-4e890e918f49 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:15.479154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577111-a19e-4f2d-85f0-4e890e918f49 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:15.479444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577111-a19e-4f2d-85f0-4e890e918f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:15.529444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-08577111-a19e-4f2d-85f0-4e890e918f49 None None] MFA Rules not processed for user `44e04e25ab764364989f9e3eb841ac0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:15.531076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-08577111-a19e-4f2d-85f0-4e890e918f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:15.706498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1149/2313] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:19:15.730814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:15.733440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:15.860254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c28e-7c5d-4dae-9fce-baefcdbe35e1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:15.866205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:15.866882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:15.878722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:15.878722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:15.900543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:15.902001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:15.923505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1165/2314] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:16.951171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976faa2-a1bf-4f5f-96d5-14cc01aa6ef0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:16.951723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976faa2-a1bf-4f5f-96d5-14cc01aa6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:16.951723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976faa2-a1bf-4f5f-96d5-14cc01aa6ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:16.984624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b976faa2-a1bf-4f5f-96d5-14cc01aa6ef0 None None] MFA Rules not processed for user `bd69ef83d23d49fcbedcd308b1edf957`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:16.985874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b976faa2-a1bf-4f5f-96d5-14cc01aa6ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:17.067273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1150/2315] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:19:17.072046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:17.073563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:17.121699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:17.148780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d187b9d-8028-4c37-adf8-3d3243bcc81d service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:17.153230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407daa3-98a0-49f3-a84b-5fdb75a688c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:17.153831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407daa3-98a0-49f3-a84b-5fdb75a688c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:17.154115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407daa3-98a0-49f3-a84b-5fdb75a688c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:17.154426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407daa3-98a0-49f3-a84b-5fdb75a688c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:17.155122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407daa3-98a0-49f3-a84b-5fdb75a688c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:17.157009 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407daa3-98a0-49f3-a84b-5fdb75a688c3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:17.184257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1166/2316] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:19:17 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:19:17.188356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976faa2-a1bf-4f5f-96d5-14cc01aa6ef0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:17.200091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976faa2-a1bf-4f5f-96d5-14cc01aa6ef0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:17.261871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09bc5f-5e69-40e3-9b31-2486e36a46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:17.262541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09bc5f-5e69-40e3-9b31-2486e36a46d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:17.262821 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09bc5f-5e69-40e3-9b31-2486e36a46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:17.263099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09bc5f-5e69-40e3-9b31-2486e36a46d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:17.263748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09bc5f-5e69-40e3-9b31-2486e36a46d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:17.265690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09bc5f-5e69-40e3-9b31-2486e36a46d7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:17.289187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1151/2317] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:19:17 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:19:17.293184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407daa3-98a0-49f3-a84b-5fdb75a688c3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:17.304232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407daa3-98a0-49f3-a84b-5fdb75a688c3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:17.308935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c24ded-e1f2-4aac-b338-0ffa3bfb4e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:17.309533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c24ded-e1f2-4aac-b338-0ffa3bfb4e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:17.309812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c24ded-e1f2-4aac-b338-0ffa3bfb4e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:17.310083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c24ded-e1f2-4aac-b338-0ffa3bfb4e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:17.310747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c24ded-e1f2-4aac-b338-0ffa3bfb4e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:17.312318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c24ded-e1f2-4aac-b338-0ffa3bfb4e33 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:17.323315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1167/2318] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:19:17.327555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09bc5f-5e69-40e3-9b31-2486e36a46d7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:17.332794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:17.339033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09bc5f-5e69-40e3-9b31-2486e36a46d7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:17.345150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996759-1aec-4fef-8f51-b53fb815aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:17.345810 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996759-1aec-4fef-8f51-b53fb815aeaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:17.346091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996759-1aec-4fef-8f51-b53fb815aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:17.346391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996759-1aec-4fef-8f51-b53fb815aeaf admin admin] PATH_INFO: `/v3/projects/d95dbb58bc1243179de233d187ba87d0/users/2f57cbb7d9bc45d6b73a76c12f5174de/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:17.363588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1996759-1aec-4fef-8f51-b53fb815aeaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95dbb58bc1243179de233d187ba87d0, user_id=2f57cbb7d9bc45d6b73a76c12f5174de, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:17.366651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1996759-1aec-4fef-8f51-b53fb815aeaf admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:17.381416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1152/2319] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:19:17 2022] PUT /identity/v3/projects/d95dbb58bc1243179de233d187ba87d0/users/2f57cbb7d9bc45d6b73a76c12f5174de/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:17.385156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c24ded-e1f2-4aac-b338-0ffa3bfb4e33 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:17.395103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c24ded-e1f2-4aac-b338-0ffa3bfb4e33 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:17.458870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34ae86-e41b-429b-86f3-3d9f594107f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:17.459755 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ae86-e41b-429b-86f3-3d9f594107f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:17.460040 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ae86-e41b-429b-86f3-3d9f594107f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:17.460311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34ae86-e41b-429b-86f3-3d9f594107f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:17.460982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34ae86-e41b-429b-86f3-3d9f594107f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:17.462722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34ae86-e41b-429b-86f3-3d9f594107f2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:17.476286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1168/2320] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:19:17.480625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996759-1aec-4fef-8f51-b53fb815aeaf admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:17.492261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996759-1aec-4fef-8f51-b53fb815aeaf admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:17.496893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31072e36-0901-4a93-8caa-0169338149a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:17.497568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31072e36-0901-4a93-8caa-0169338149a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:17.497832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31072e36-0901-4a93-8caa-0169338149a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:17.498178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31072e36-0901-4a93-8caa-0169338149a8 admin admin] PATH_INFO: `/v3/projects/d95dbb58bc1243179de233d187ba87d0/users/2f57cbb7d9bc45d6b73a76c12f5174de/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:17.500988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31072e36-0901-4a93-8caa-0169338149a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95dbb58bc1243179de233d187ba87d0, user_id=2f57cbb7d9bc45d6b73a76c12f5174de, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:17.503617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31072e36-0901-4a93-8caa-0169338149a8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:17.518535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1153/2321] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:19:17 2022] PUT /identity/v3/projects/d95dbb58bc1243179de233d187ba87d0/users/2f57cbb7d9bc45d6b73a76c12f5174de/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:18.879646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34ae86-e41b-429b-86f3-3d9f594107f2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:18.892638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34ae86-e41b-429b-86f3-3d9f594107f2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:18.980196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:18.980862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:18.981147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:18.981420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] PATH_INFO: `/v3/users/44e04e25ab764364989f9e3eb841ac0a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:18.984208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e04e25ab764364989f9e3eb841ac0a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:18.986341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:19.094988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e04e25ab764364989f9e3eb841ac0a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:19.099217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:19.119231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e04e25ab764364989f9e3eb841ac0a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:19.121443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e04e25ab764364989f9e3eb841ac0a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:19.136919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e04e25ab764364989f9e3eb841ac0a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:19.138238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e04e25ab764364989f9e3eb841ac0a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:19.166038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1169/2322] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:19:18 2022] DELETE /identity/v3/users/44e04e25ab764364989f9e3eb841ac0a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:19.170566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fed8a-2b07-47da-bc72-604913fa1295 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:19.170973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fed8a-2b07-47da-bc72-604913fa1295 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:19.171174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fed8a-2b07-47da-bc72-604913fa1295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:19.193351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-780fed8a-2b07-47da-bc72-604913fa1295 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:19.195511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-780fed8a-2b07-47da-bc72-604913fa1295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:19.273432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1154/2323] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:19:19.283927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:19.285527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:19.359673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a243-5a8a-471f-94a3-d7d77c38b227 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:19.363759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137091d8-e2ae-41a8-82ea-90bfde4e4986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:19.364398 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137091d8-e2ae-41a8-82ea-90bfde4e4986 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:19.364677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137091d8-e2ae-41a8-82ea-90bfde4e4986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:19.364949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137091d8-e2ae-41a8-82ea-90bfde4e4986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:19.377529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137091d8-e2ae-41a8-82ea-90bfde4e4986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:19.379865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137091d8-e2ae-41a8-82ea-90bfde4e4986 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:19.390957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1170/2324] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:19.966479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fed8a-2b07-47da-bc72-604913fa1295 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:19.968211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-780fed8a-2b07-47da-bc72-604913fa1295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:19.981387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fed8a-2b07-47da-bc72-604913fa1295 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:19.986907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:19.987561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:19.987847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:19.988128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] PATH_INFO: `/v3/projects/0bdc9df7037e4f74b2541715b64e7708` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:19.991090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdc9df7037e4f74b2541715b64e7708)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:19.993601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:20.088600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdc9df7037e4f74b2541715b64e7708', 'request_id': 'req-5ff70899-8267-4349-932e-8c3121098919'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:20.096463 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdc9df7037e4f74b2541715b64e7708', 'request_id': 'req-5ff70899-8267-4349-932e-8c3121098919'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:20.108697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdc9df7037e4f74b2541715b64e7708', 'request_id': 'req-5ff70899-8267-4349-932e-8c3121098919'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:20.151866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] The token cache is being invalidate because project 0bdc9df7037e4f74b2541715b64e7708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:19:20.152352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:20.154138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:19:20.162544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1155/2325] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:19:19 2022] DELETE /identity/v3/projects/0bdc9df7037e4f74b2541715b64e7708 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:19:23.126368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5e9ff-8272-4547-bbd8-c20df20df4f2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:23.127230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5e9ff-8272-4547-bbd8-c20df20df4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:23.127905 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5e9ff-8272-4547-bbd8-c20df20df4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:23.173809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-71b5e9ff-8272-4547-bbd8-c20df20df4f2 None None] MFA Rules not processed for user `2f57cbb7d9bc45d6b73a76c12f5174de`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:23.175860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-71b5e9ff-8272-4547-bbd8-c20df20df4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:23.272895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1171/2326] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:19:23.286806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:23.289553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:23.343675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:23.370605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70899-8267-4349-932e-8c3121098919 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:23.376841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:23.377464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:23.377805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:23.379015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:23.381470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:23.460250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:23.461724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:23.479126 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1156/2327] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:25.793270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510e99-27eb-4ae7-9103-1f4250c30870 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:25.794668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510e99-27eb-4ae7-9103-1f4250c30870 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:25.795152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510e99-27eb-4ae7-9103-1f4250c30870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:25.820594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b5510e99-27eb-4ae7-9103-1f4250c30870 None None] MFA Rules not processed for user `bd69ef83d23d49fcbedcd308b1edf957`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:19:25.822036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b5510e99-27eb-4ae7-9103-1f4250c30870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:25.832958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1172/2328] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:19:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:19:33.467345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=34 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:35.814955 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=74,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:53.635853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:53.637364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:53.706147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765394bf-9de6-4c98-bb98-29b67e090415 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:53.710759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:53.712274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:53.712562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:53.712843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:53.714728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:53.726488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:53.727999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:53.738386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1157/2329] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:20:03.733606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=32 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:48.439162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5510e99-27eb-4ae7-9103-1f4250c30870 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:20:48.440696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b5510e99-27eb-4ae7-9103-1f4250c30870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:48.499874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5510e99-27eb-4ae7-9103-1f4250c30870 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:20:48.503434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:20:48.504035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:20:48.504182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:20:48.504660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:20:48.504660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:20:48.506238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:48.514482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dafebf-9942-48e4-866a-45d8a58f974a service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:20:48.518597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:20:48.519232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:20:48.519660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:20:48.519939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:20:48.520775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:20:48.522155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:48.522519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:20:48.535796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1173/2330] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:20:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:20:48.536122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:20:48.537332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:20:48.549246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1158/2331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:20:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:20:58.529956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=26 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:58.544074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:04.829889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:04.841686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2a00-f1b0-4875-8e0d-aca0be675cce service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:04.848253 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:04.848876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:04.849160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:04.849437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:04.851503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:04.914236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:04.915867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:04.925853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1174/2332] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:05.907538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:05.909059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:05.923480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e71ed-c1f9-4d74-981d-24fc307f0d85 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:05.929094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:05.929704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:05.929986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:05.930279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:05.932118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:05.990508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:05.992119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:06.001516 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1159/2333] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:12.871563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:12.883556 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef56a-f1bd-4bf6-a9b7-84a80d6da297 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:12.889042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dfdee-82a8-4c1b-a438-1245ba08642c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:12.889647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dfdee-82a8-4c1b-a438-1245ba08642c service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:12.890560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dfdee-82a8-4c1b-a438-1245ba08642c service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:12.890837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dfdee-82a8-4c1b-a438-1245ba08642c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:12.892775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1f3dfdee-82a8-4c1b-a438-1245ba08642c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:12.950860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dfdee-82a8-4c1b-a438-1245ba08642c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:12.953152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dfdee-82a8-4c1b-a438-1245ba08642c service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:12.962137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1175/2334] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:14.581540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:14.594216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f8d2d-2903-484e-95b9-295e9358518d service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:14.600035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db60fe-a70c-45be-86ac-e16641a23425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:14.600650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db60fe-a70c-45be-86ac-e16641a23425 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:14.600937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db60fe-a70c-45be-86ac-e16641a23425 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:14.601218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db60fe-a70c-45be-86ac-e16641a23425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:14.602988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-44db60fe-a70c-45be-86ac-e16641a23425 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:14.668331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db60fe-a70c-45be-86ac-e16641a23425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:14.669978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db60fe-a70c-45be-86ac-e16641a23425 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:14.680641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1160/2335] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:22.957963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=56 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:24.676009 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=56 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:13.367815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943b65-8564-4269-a5dd-c957193becfc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:13.368576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943b65-8564-4269-a5dd-c957193becfc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:13.368576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943b65-8564-4269-a5dd-c957193becfc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:13.369705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1176/2336] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 08:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:22:13.376218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c050a-aafb-430d-ad7d-f7623a8f920b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:13.376863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c050a-aafb-430d-ad7d-f7623a8f920b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:13.376863 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c050a-aafb-430d-ad7d-f7623a8f920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:13.409961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-fa8c050a-aafb-430d-ad7d-f7623a8f920b None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:13.411448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fa8c050a-aafb-430d-ad7d-f7623a8f920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:13.426423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1161/2337] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:22:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:13.461478 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943b65-8564-4269-a5dd-c957193becfc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:13.475641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943b65-8564-4269-a5dd-c957193becfc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:13.482655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d50241-4fd7-490b-a9df-4030f35ada1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:13.483752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50241-4fd7-490b-a9df-4030f35ada1b service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:13.484272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50241-4fd7-490b-a9df-4030f35ada1b service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:13.484648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d50241-4fd7-490b-a9df-4030f35ada1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:13.494429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d50241-4fd7-490b-a9df-4030f35ada1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:13.496027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d50241-4fd7-490b-a9df-4030f35ada1b service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:13.507270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1177/2338] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:22:13.718107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c050a-aafb-430d-ad7d-f7623a8f920b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:13.719556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fa8c050a-aafb-430d-ad7d-f7623a8f920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:13.730844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c050a-aafb-430d-ad7d-f7623a8f920b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:13.734624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2876893-b6cd-4e3a-be3e-6c92bab891bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:13.735208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876893-b6cd-4e3a-be3e-6c92bab891bf service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:13.735491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876893-b6cd-4e3a-be3e-6c92bab891bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:13.735766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2876893-b6cd-4e3a-be3e-6c92bab891bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:13.737431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b2876893-b6cd-4e3a-be3e-6c92bab891bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:13.802519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2876893-b6cd-4e3a-be3e-6c92bab891bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:13.803964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2876893-b6cd-4e3a-be3e-6c92bab891bf service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:13.813980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1162/2339] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:17.565394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eeb14-69fb-442c-b692-dc1a92c4d455 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:17.566319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eeb14-69fb-442c-b692-dc1a92c4d455 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:17.566997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eeb14-69fb-442c-b692-dc1a92c4d455 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:17.568697 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1178/2340] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 08:22:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:22:17.580849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd99d-a6b1-4a46-a5be-d7612f8dd90e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:17.582474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd99d-a6b1-4a46-a5be-d7612f8dd90e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:17.583405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd99d-a6b1-4a46-a5be-d7612f8dd90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:17.617900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-943bd99d-a6b1-4a46-a5be-d7612f8dd90e None None] MFA Rules not processed for user `61c0e264e31845b9811944ba6cf976be`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:17.619501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-943bd99d-a6b1-4a46-a5be-d7612f8dd90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:17.630887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1163/2341] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:22:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:17.664701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eeb14-69fb-442c-b692-dc1a92c4d455 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:17.690756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eeb14-69fb-442c-b692-dc1a92c4d455 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:17.699640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:17.701028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:17.701661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:17.702375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:17.719559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:17.722651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:17.738173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1179/2342] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:17.851527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bd99d-a6b1-4a46-a5be-d7612f8dd90e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:17.856148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-943bd99d-a6b1-4a46-a5be-d7612f8dd90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:17.898835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bd99d-a6b1-4a46-a5be-d7612f8dd90e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:17.909682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:17.910185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:17.910706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:17.912110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:17.913230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:17.927651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:17.929544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:17.941318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1164/2343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:17.946897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:17.949306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:17.975792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77409-bd44-43c5-b86f-26ae17d9dee7 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:17.985712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:17.986861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:17.987401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:17.987934 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] PATH_INFO: `/v3/users/c5d55971cbce4c61a81b158aa666e2ea` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:17.989706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d55971cbce4c61a81b158aa666e2ea)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:17.991889 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:18.049792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d55971cbce4c61a81b158aa666e2ea'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.059367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d55971cbce4c61a81b158aa666e2ea'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.060887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d55971cbce4c61a81b158aa666e2ea'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.068954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d55971cbce4c61a81b158aa666e2ea'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.069672 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d55971cbce4c61a81b158aa666e2ea'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.092038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1180/2344] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:17 2022] DELETE /identity/v3/users/c5d55971cbce4c61a81b158aa666e2ea => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:18.217625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:18.227281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a490be-1dc2-49d0-b35c-886be89856ef service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:18.284778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988bcc0-d5e1-404f-92cf-f435a8378bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:18.285443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988bcc0-d5e1-404f-92cf-f435a8378bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.285797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988bcc0-d5e1-404f-92cf-f435a8378bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.286146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988bcc0-d5e1-404f-92cf-f435a8378bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.288231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e988bcc0-d5e1-404f-92cf-f435a8378bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:18.333770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:18.335864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:18.381544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988bcc0-d5e1-404f-92cf-f435a8378bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:18.383269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988bcc0-d5e1-404f-92cf-f435a8378bdf service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:18.400556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1165/2345] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:18.436299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f53cbc-ad36-4668-925d-e9d2e6dad7d4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:18.449276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:18.449677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.450102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.450528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] PATH_INFO: `/v3/projects/e17cd7e07aa94984a3ecdb3fbce1b097` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.451687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17cd7e07aa94984a3ecdb3fbce1b097)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:18.453931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:18.519489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:18.520690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'request_id': 'req-438ab5e0-b349-428e-81d3-a398f991d160'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.530531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'request_id': 'req-438ab5e0-b349-428e-81d3-a398f991d160'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.538059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17cd7e07aa94984a3ecdb3fbce1b097', 'request_id': 'req-438ab5e0-b349-428e-81d3-a398f991d160'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.553908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] The token cache is being invalidate because project e17cd7e07aa94984a3ecdb3fbce1b097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:18.554195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.555027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-438ab5e0-b349-428e-81d3-a398f991d160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:18.556761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1181/2346] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:18 2022] DELETE /identity/v3/projects/e17cd7e07aa94984a3ecdb3fbce1b097 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:18.563489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb0ca6-cc6d-4578-9a1e-c2a599ef69f2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.563782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb0ca6-cc6d-4578-9a1e-c2a599ef69f2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.564071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb0ca6-cc6d-4578-9a1e-c2a599ef69f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.586124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-72cb0ca6-cc6d-4578-9a1e-c2a599ef69f2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:18.587676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-72cb0ca6-cc6d-4578-9a1e-c2a599ef69f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:18.601153 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:18.653961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1166/2347] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:18.662464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb36d6-a82e-40cc-8d8d-ea8374ec603c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.663023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb36d6-a82e-40cc-8d8d-ea8374ec603c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.663023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb36d6-a82e-40cc-8d8d-ea8374ec603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.685544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b3fb36d6-a82e-40cc-8d8d-ea8374ec603c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:18.686823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b3fb36d6-a82e-40cc-8d8d-ea8374ec603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:18.695063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1182/2348] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:18.699439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb0ca6-cc6d-4578-9a1e-c2a599ef69f2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:18.709446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb0ca6-cc6d-4578-9a1e-c2a599ef69f2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:18.714438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:18.715049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.715335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.715612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.716799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:18.717106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:18.718752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:18.730866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1167/2349] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:18.736205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb36d6-a82e-40cc-8d8d-ea8374ec603c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:18.747164 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb36d6-a82e-40cc-8d8d-ea8374ec603c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:18.752729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83e407-b7ac-4be7-9cde-8a30a4e96238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:18.753436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e407-b7ac-4be7-9cde-8a30a4e96238 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.753843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e407-b7ac-4be7-9cde-8a30a4e96238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.754389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e407-b7ac-4be7-9cde-8a30a4e96238 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.755105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83e407-b7ac-4be7-9cde-8a30a4e96238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:18.757257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83e407-b7ac-4be7-9cde-8a30a4e96238 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:18.796093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1183/2350] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:18 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:18.797408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:18.807908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53144c4e-6d6c-4fa0-bbc3-3fb2274f64fe admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:18.873548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38604aa6-3231-41a2-ab22-bb68b0a71095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:18.874303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38604aa6-3231-41a2-ab22-bb68b0a71095 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.874719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38604aa6-3231-41a2-ab22-bb68b0a71095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.875099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38604aa6-3231-41a2-ab22-bb68b0a71095 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.875864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38604aa6-3231-41a2-ab22-bb68b0a71095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:18.877888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38604aa6-3231-41a2-ab22-bb68b0a71095 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:18.908249 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1168/2351] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:18 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:18.913046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83e407-b7ac-4be7-9cde-8a30a4e96238 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:18.926159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83e407-b7ac-4be7-9cde-8a30a4e96238 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:18.934726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fb262-d480-49ea-983c-3ecb35b7d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:18.935874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fb262-d480-49ea-983c-3ecb35b7d0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.936351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fb262-d480-49ea-983c-3ecb35b7d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.936969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fb262-d480-49ea-983c-3ecb35b7d0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.937816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fb262-d480-49ea-983c-3ecb35b7d0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:18.940014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fb262-d480-49ea-983c-3ecb35b7d0e6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:18.962918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1184/2352] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:18.970437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38604aa6-3231-41a2-ab22-bb68b0a71095 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:18.983178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38604aa6-3231-41a2-ab22-bb68b0a71095 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:18.988866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a9e35-e96d-4788-8ebe-ac03656653de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:18.989590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9e35-e96d-4788-8ebe-ac03656653de admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:18.989948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9e35-e96d-4788-8ebe-ac03656653de admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:18.989948 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9e35-e96d-4788-8ebe-ac03656653de admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:18.991040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a9e35-e96d-4788-8ebe-ac03656653de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:18.993054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a9e35-e96d-4788-8ebe-ac03656653de admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:19.006493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1169/2353] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:19.010653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fb262-d480-49ea-983c-3ecb35b7d0e6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:19.023512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fb262-d480-49ea-983c-3ecb35b7d0e6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:19.031965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:19.031965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:19.031965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:19.033447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] PATH_INFO: `/v3/projects/e8088d87969e46a2b2cc69dd7297ae14/users/ccd2c619e9fc436ea01a1200bc46b60f/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:19.055011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8088d87969e46a2b2cc69dd7297ae14, user_id=ccd2c619e9fc436ea01a1200bc46b60f, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:19.058015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:19.076730 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1185/2354] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:19 2022] PUT /identity/v3/projects/e8088d87969e46a2b2cc69dd7297ae14/users/ccd2c619e9fc436ea01a1200bc46b60f/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:19.082541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7515ab-c6b4-4d1c-b44a-a4821d10a41b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:19.082875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7515ab-c6b4-4d1c-b44a-a4821d10a41b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:19.083283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7515ab-c6b4-4d1c-b44a-a4821d10a41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:19.113593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ad7515ab-c6b4-4d1c-b44a-a4821d10a41b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:19.114906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ad7515ab-c6b4-4d1c-b44a-a4821d10a41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:19.190574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1170/2355] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:19.232311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:19.236296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:19.314049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e7f66-947a-407b-99cd-788408f4334f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:19.318146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccdcc4-24cc-4236-8228-48303cffe7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:19.318884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccdcc4-24cc-4236-8228-48303cffe7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:19.319222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccdcc4-24cc-4236-8228-48303cffe7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:19.319566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccdcc4-24cc-4236-8228-48303cffe7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:19.332948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccdcc4-24cc-4236-8228-48303cffe7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:19.334516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccdcc4-24cc-4236-8228-48303cffe7a8 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:19.347791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1186/2356] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:25.197270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7515ab-c6b4-4d1c-b44a-a4821d10a41b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:25.198908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ad7515ab-c6b4-4d1c-b44a-a4821d10a41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:25.228046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7515ab-c6b4-4d1c-b44a-a4821d10a41b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:25.260493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:25.261156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.261434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.261895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] PATH_INFO: `/v3/users/854e77042ee14f7f806a33f9c9501bb0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.264322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854e77042ee14f7f806a33f9c9501bb0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:25.274009 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:25.331849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:25.392986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854e77042ee14f7f806a33f9c9501bb0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:25.413565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854e77042ee14f7f806a33f9c9501bb0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:25.414040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854e77042ee14f7f806a33f9c9501bb0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:25.439599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854e77042ee14f7f806a33f9c9501bb0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:25.464767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-416c41f8-638c-4908-ae19-ae65a6fc1ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854e77042ee14f7f806a33f9c9501bb0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:25.476967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1171/2357] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:25 2022] DELETE /identity/v3/users/854e77042ee14f7f806a33f9c9501bb0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:25.990671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccdcc4-24cc-4236-8228-48303cffe7a8 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:26.004788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccdcc4-24cc-4236-8228-48303cffe7a8 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:26.155818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:26.156408 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:26.156698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:26.157015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] PATH_INFO: `/v3/projects/7d43ea736fc0496d841b2530242dfde6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:26.164194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d43ea736fc0496d841b2530242dfde6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:26.169751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:26.210000 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:26.297847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d43ea736fc0496d841b2530242dfde6', 'request_id': 'req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:26.314174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d43ea736fc0496d841b2530242dfde6', 'request_id': 'req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:26.327111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d43ea736fc0496d841b2530242dfde6', 'request_id': 'req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:26.350927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] The token cache is being invalidate because project 7d43ea736fc0496d841b2530242dfde6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:26.351494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:26.352373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8692ecac-7e71-4fb3-8c67-5a3ccb3c7b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:26.354562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1187/2358] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:25 2022] DELETE /identity/v3/projects/7d43ea736fc0496d841b2530242dfde6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:26.363449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d743-0dc0-40d4-965d-18584ae54773 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:26.364150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d743-0dc0-40d4-965d-18584ae54773 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:26.364150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d743-0dc0-40d4-965d-18584ae54773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:26.403671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5108d743-0dc0-40d4-965d-18584ae54773 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:26.406856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5108d743-0dc0-40d4-965d-18584ae54773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:26.594989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1172/2359] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:26.605843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821190c-61f3-4eec-96e3-2421195e6cc9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:26.609724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821190c-61f3-4eec-96e3-2421195e6cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:26.609724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821190c-61f3-4eec-96e3-2421195e6cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:26.643481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1821190c-61f3-4eec-96e3-2421195e6cc9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:26.645427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1821190c-61f3-4eec-96e3-2421195e6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:26.662789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1188/2360] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:26.664218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d743-0dc0-40d4-965d-18584ae54773 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:26.680160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d743-0dc0-40d4-965d-18584ae54773 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:26.688150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:26.688992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:26.689380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:26.690053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:26.690889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:26.691306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:26.696847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:26.724845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1173/2361] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:26.726847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821190c-61f3-4eec-96e3-2421195e6cc9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:26.745935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821190c-61f3-4eec-96e3-2421195e6cc9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:26.752336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad8e10-8184-41aa-b910-98e35a9b2f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:26.752968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad8e10-8184-41aa-b910-98e35a9b2f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:26.753238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad8e10-8184-41aa-b910-98e35a9b2f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:26.757568 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad8e10-8184-41aa-b910-98e35a9b2f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:26.758441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad8e10-8184-41aa-b910-98e35a9b2f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:26.760641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad8e10-8184-41aa-b910-98e35a9b2f5c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:26.837166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1189/2362] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:26 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:26.844224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:26.858755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e246b-cadf-4906-864f-43c23f3a19d9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:26.993682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603b6c-f1a0-4e7a-b0b9-72e554c72162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:26.994429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603b6c-f1a0-4e7a-b0b9-72e554c72162 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:26.994910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603b6c-f1a0-4e7a-b0b9-72e554c72162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:26.995378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603b6c-f1a0-4e7a-b0b9-72e554c72162 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:26.996205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc603b6c-f1a0-4e7a-b0b9-72e554c72162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:26.999573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc603b6c-f1a0-4e7a-b0b9-72e554c72162 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:27.035822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1174/2363] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:26 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:27.042244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad8e10-8184-41aa-b910-98e35a9b2f5c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:27.075743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad8e10-8184-41aa-b910-98e35a9b2f5c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:27.083831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e1c0-d53f-4c87-bdc5-586a4da653a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:27.084998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e1c0-d53f-4c87-bdc5-586a4da653a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:27.085558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e1c0-d53f-4c87-bdc5-586a4da653a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:27.086105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e1c0-d53f-4c87-bdc5-586a4da653a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:27.087394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61e1c0-d53f-4c87-bdc5-586a4da653a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:27.091886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61e1c0-d53f-4c87-bdc5-586a4da653a4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:27.110651 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1190/2364] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:27.116737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603b6c-f1a0-4e7a-b0b9-72e554c72162 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:27.134138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603b6c-f1a0-4e7a-b0b9-72e554c72162 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:27.143146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d0934-7a5c-45f7-99c5-6b0f68bfa313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:27.144962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0934-7a5c-45f7-99c5-6b0f68bfa313 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:27.145538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5642-d618-4dd8-a583-f630b14c5990 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:27.146108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0934-7a5c-45f7-99c5-6b0f68bfa313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:27.146678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5642-d618-4dd8-a583-f630b14c5990 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:27.147078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5642-d618-4dd8-a583-f630b14c5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:27.148241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0934-7a5c-45f7-99c5-6b0f68bfa313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:27.150211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d0934-7a5c-45f7-99c5-6b0f68bfa313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:27.156691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d0934-7a5c-45f7-99c5-6b0f68bfa313 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:27.171732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-371b5642-d618-4dd8-a583-f630b14c5990 None None] MFA Rules not processed for user `eaf3d36d40d442019e09a3e4c32b8330`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:27.174920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-371b5642-d618-4dd8-a583-f630b14c5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:27.191537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1175/2365] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:27.193494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d0934-7a5c-45f7-99c5-6b0f68bfa313 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:27.199695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:27.208307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d0934-7a5c-45f7-99c5-6b0f68bfa313 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:27.217909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd64cf-d03b-4418-ad74-5509e0bc3ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:27.219132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd64cf-d03b-4418-ad74-5509e0bc3ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:27.220497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd64cf-d03b-4418-ad74-5509e0bc3ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:27.220878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd64cf-d03b-4418-ad74-5509e0bc3ba8 admin admin] PATH_INFO: `/v3/projects/5d72fb44169d405dbf647ddb72b06934/users/71d7b406ff944c23b7e947ae0eae73ed/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:27.243405 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd64cf-d03b-4418-ad74-5509e0bc3ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d72fb44169d405dbf647ddb72b06934, user_id=71d7b406ff944c23b7e947ae0eae73ed, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:27.248610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd64cf-d03b-4418-ad74-5509e0bc3ba8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:27.269572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1176/2366] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:27 2022] PUT /identity/v3/projects/5d72fb44169d405dbf647ddb72b06934/users/71d7b406ff944c23b7e947ae0eae73ed/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:27.282507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115efba-7c8b-4208-b90e-851e97b29414 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:27.282883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115efba-7c8b-4208-b90e-851e97b29414 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:27.283190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115efba-7c8b-4208-b90e-851e97b29414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:27.284423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1191/2367] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:27.322043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e115efba-7c8b-4208-b90e-851e97b29414 None None] MFA Rules not processed for user `71d7b406ff944c23b7e947ae0eae73ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:27.323663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e115efba-7c8b-4208-b90e-851e97b29414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:27.442520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1177/2368] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:22:27.450602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5642-d618-4dd8-a583-f630b14c5990 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:27.452085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-371b5642-d618-4dd8-a583-f630b14c5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:27.560317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5642-d618-4dd8-a583-f630b14c5990 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:27.566582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:27.660139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ab2e5-b1c3-4e5d-b2cb-205bc2fcefa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:27.660765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ab2e5-b1c3-4e5d-b2cb-205bc2fcefa3 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:27.661044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ab2e5-b1c3-4e5d-b2cb-205bc2fcefa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:27.661317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ab2e5-b1c3-4e5d-b2cb-205bc2fcefa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:27.671116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ab2e5-b1c3-4e5d-b2cb-205bc2fcefa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:27.672747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ab2e5-b1c3-4e5d-b2cb-205bc2fcefa3 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:27.683116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1192/2369] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:28.230509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115efba-7c8b-4208-b90e-851e97b29414 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:28.233932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e115efba-7c8b-4208-b90e-851e97b29414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:28.384000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115efba-7c8b-4208-b90e-851e97b29414 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:28.399669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08b8e1-3fd2-464e-886c-5e3932b44ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:28.400473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08b8e1-3fd2-464e-886c-5e3932b44ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:28.400763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08b8e1-3fd2-464e-886c-5e3932b44ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:28.401039 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08b8e1-3fd2-464e-886c-5e3932b44ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:28.405681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-dc08b8e1-3fd2-464e-886c-5e3932b44ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:28.424448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08b8e1-3fd2-464e-886c-5e3932b44ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:28.426086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08b8e1-3fd2-464e-886c-5e3932b44ca7 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:28.452192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1178/2370] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:28.892301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caf03-27e8-4e38-a270-3ad9d3711496 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:28.893224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caf03-27e8-4e38-a270-3ad9d3711496 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:28.893508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209caf03-27e8-4e38-a270-3ad9d3711496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:28.926174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-209caf03-27e8-4e38-a270-3ad9d3711496 None None] MFA Rules not processed for user `ccd2c619e9fc436ea01a1200bc46b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:28.927508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-209caf03-27e8-4e38-a270-3ad9d3711496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:29.052768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1193/2371] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:29.067381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213cbb9-0605-406b-91a5-05ed778f3bab None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:29.067974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213cbb9-0605-406b-91a5-05ed778f3bab None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:29.068419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213cbb9-0605-406b-91a5-05ed778f3bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:29.072130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209caf03-27e8-4e38-a270-3ad9d3711496 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:29.106936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209caf03-27e8-4e38-a270-3ad9d3711496 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:29.112120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2213cbb9-0605-406b-91a5-05ed778f3bab None None] MFA Rules not processed for user `7559a0b8d46b4524b40f68b992f6cfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:29.114730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2213cbb9-0605-406b-91a5-05ed778f3bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:29.119531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:29.122420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:29.122859 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:29.123204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:29.136041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:29.139494 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:29.162170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1194/2372] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:22:29.163294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:29.164885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:29.243141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1179/2373] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:29.307086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e26ff-4c48-4fcb-8371-cfa767c2a08f service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:29.313237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b1384-4c12-416f-829f-d855ba4a1e6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:29.314211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1384-4c12-416f-829f-d855ba4a1e6b service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:29.314670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1384-4c12-416f-829f-d855ba4a1e6b service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:29.315558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1384-4c12-416f-829f-d855ba4a1e6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:29.318816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2a0b1384-4c12-416f-829f-d855ba4a1e6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:29.335045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b1384-4c12-416f-829f-d855ba4a1e6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:29.337244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b1384-4c12-416f-829f-d855ba4a1e6b service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:29.353754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:29.361141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1195/2374] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:31.255370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213cbb9-0605-406b-91a5-05ed778f3bab None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:31.270669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:31.341577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213cbb9-0605-406b-91a5-05ed778f3bab None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:31.347582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:31.349067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:31.349422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:31.349793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] PATH_INFO: `/v3/users/71d7b406ff944c23b7e947ae0eae73ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:31.351409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d7b406ff944c23b7e947ae0eae73ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:31.353718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:31.414442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3822-bf48-47fa-81fb-ebfad7fad0cf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:31.415347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3822-bf48-47fa-81fb-ebfad7fad0cf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:31.415347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b3822-bf48-47fa-81fb-ebfad7fad0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:31.444748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b47b3822-bf48-47fa-81fb-ebfad7fad0cf None None] MFA Rules not processed for user `ccd2c619e9fc436ea01a1200bc46b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:31.446199 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b47b3822-bf48-47fa-81fb-ebfad7fad0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:31.463004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1196/2375] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:31.463683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d7b406ff944c23b7e947ae0eae73ed'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:31.480713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d7b406ff944c23b7e947ae0eae73ed'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:31.482562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d7b406ff944c23b7e947ae0eae73ed'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:31.497493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d7b406ff944c23b7e947ae0eae73ed'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:31.526574 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d7b406ff944c23b7e947ae0eae73ed'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:31.534651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1180/2376] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:31 2022] DELETE /identity/v3/users/71d7b406ff944c23b7e947ae0eae73ed => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:31.539014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ad93d-09e8-497b-834a-227d93a12513 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:31.539416 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ad93d-09e8-497b-834a-227d93a12513 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:31.539774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ad93d-09e8-497b-834a-227d93a12513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:31.570174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7e6ad93d-09e8-497b-834a-227d93a12513 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:31.571756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e6ad93d-09e8-497b-834a-227d93a12513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:31.661417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1197/2377] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:22:31.670491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:31.676327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:31.756103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4788d-321c-467b-ac73-6c8e277ce423 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:31.760320 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:31.761236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:31.761898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:31.762411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:31.778365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:31.780000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:31.806515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1181/2378] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:32.082394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ad93d-09e8-497b-834a-227d93a12513 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:32.083835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e6ad93d-09e8-497b-834a-227d93a12513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:32.099008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ad93d-09e8-497b-834a-227d93a12513 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:32.104481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b736d63-00b2-4fd9-9cac-3ca1f0a42858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:32.105635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b736d63-00b2-4fd9-9cac-3ca1f0a42858 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.105635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b736d63-00b2-4fd9-9cac-3ca1f0a42858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.105635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b736d63-00b2-4fd9-9cac-3ca1f0a42858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.112747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9b736d63-00b2-4fd9-9cac-3ca1f0a42858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:32.124486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b736d63-00b2-4fd9-9cac-3ca1f0a42858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:32.125872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b736d63-00b2-4fd9-9cac-3ca1f0a42858 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:32.142500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1198/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:32.168133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:32.170444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:32.192671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8304cb3-712e-44c8-9976-5c9e35286ce3 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:32.200171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:32.201120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.201718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.202173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] PATH_INFO: `/v3/projects/5d72fb44169d405dbf647ddb72b06934` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.204326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d72fb44169d405dbf647ddb72b06934)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:32.206431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:32.253498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:32.272604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d72fb44169d405dbf647ddb72b06934', 'request_id': 'req-140f97ab-21db-4f84-8696-2ca695cf2525'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:32.284240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d72fb44169d405dbf647ddb72b06934', 'request_id': 'req-140f97ab-21db-4f84-8696-2ca695cf2525'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:32.297849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d72fb44169d405dbf647ddb72b06934', 'request_id': 'req-140f97ab-21db-4f84-8696-2ca695cf2525'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:32.312226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] The token cache is being invalidate because project 5d72fb44169d405dbf647ddb72b06934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:32.312741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:32.313589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-140f97ab-21db-4f84-8696-2ca695cf2525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:32.315482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1182/2380] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:32 2022] DELETE /identity/v3/projects/5d72fb44169d405dbf647ddb72b06934 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:32.320375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8f305-128e-446b-ae4b-c53b60f35c30 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.320714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8f305-128e-446b-ae4b-c53b60f35c30 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.320992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8f305-128e-446b-ae4b-c53b60f35c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.354162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-39e8f305-128e-446b-ae4b-c53b60f35c30 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:32.358387 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-39e8f305-128e-446b-ae4b-c53b60f35c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:32.463352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1199/2381] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:32.464811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59faa9b-6430-4f62-abbc-8ab030b34b87 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.465884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59faa9b-6430-4f62-abbc-8ab030b34b87 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.471274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59faa9b-6430-4f62-abbc-8ab030b34b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.497223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f59faa9b-6430-4f62-abbc-8ab030b34b87 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:32.498431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f59faa9b-6430-4f62-abbc-8ab030b34b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:32.512849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1183/2382] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:32.518362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8f305-128e-446b-ae4b-c53b60f35c30 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:32.534954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8f305-128e-446b-ae4b-c53b60f35c30 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:32.541845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:32.542572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.542866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.543147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.543884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:32.544577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:32.546378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:32.569240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1200/2383] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:32.570589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59faa9b-6430-4f62-abbc-8ab030b34b87 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:32.587961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59faa9b-6430-4f62-abbc-8ab030b34b87 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:32.594912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f4ee-a0a5-4dd9-b6c5-4104ceeb02ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:32.595754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f4ee-a0a5-4dd9-b6c5-4104ceeb02ee admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.596410 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f4ee-a0a5-4dd9-b6c5-4104ceeb02ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.596831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f4ee-a0a5-4dd9-b6c5-4104ceeb02ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.597754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f4ee-a0a5-4dd9-b6c5-4104ceeb02ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:32.600114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95f4ee-a0a5-4dd9-b6c5-4104ceeb02ee admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:32.677675 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1184/2384] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:32 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:32.685331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:32.726208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739f3c4-9014-4e42-9027-079502acb57c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:32.867057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa54e-414a-4982-9155-44ce98f9d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:32.867702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa54e-414a-4982-9155-44ce98f9d7cd admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.867992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa54e-414a-4982-9155-44ce98f9d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.868272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa54e-414a-4982-9155-44ce98f9d7cd admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.868954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa54e-414a-4982-9155-44ce98f9d7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:32.872260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa54e-414a-4982-9155-44ce98f9d7cd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:32.897276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:32.907049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1201/2385] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:32 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:32.914630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f4ee-a0a5-4dd9-b6c5-4104ceeb02ee admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:32.936128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95f4ee-a0a5-4dd9-b6c5-4104ceeb02ee admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:32.943378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac885f-84d8-41ae-87a7-7f13e5fce80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:32.944422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac885f-84d8-41ae-87a7-7f13e5fce80a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.944990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac885f-84d8-41ae-87a7-7f13e5fce80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.945644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac885f-84d8-41ae-87a7-7f13e5fce80a admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.946785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac885f-84d8-41ae-87a7-7f13e5fce80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:32.949898 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac885f-84d8-41ae-87a7-7f13e5fce80a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:32.962510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1185/2386] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:32.966210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa54e-414a-4982-9155-44ce98f9d7cd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:32.976203 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa54e-414a-4982-9155-44ce98f9d7cd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:32.981472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4cbce-b902-49f6-9a7b-fc0721e0a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:32.982286 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4cbce-b902-49f6-9a7b-fc0721e0a351 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.982589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4cbce-b902-49f6-9a7b-fc0721e0a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.982860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4cbce-b902-49f6-9a7b-fc0721e0a351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.983501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4cbce-b902-49f6-9a7b-fc0721e0a351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:32.985107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4cbce-b902-49f6-9a7b-fc0721e0a351 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.001331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1202/2387] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:33.007824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac885f-84d8-41ae-87a7-7f13e5fce80a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.028455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac885f-84d8-41ae-87a7-7f13e5fce80a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.034000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26144-3ed0-4a7b-8265-6e5926abf5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.034767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26144-3ed0-4a7b-8265-6e5926abf5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.035022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26144-3ed0-4a7b-8265-6e5926abf5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.035310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26144-3ed0-4a7b-8265-6e5926abf5f7 admin admin] PATH_INFO: `/v3/projects/33c0e3f390ca49098a49a2a619bc1564/users/35b6c729749d44ad9469abae2ddd6c2b/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.056773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f26144-3ed0-4a7b-8265-6e5926abf5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c0e3f390ca49098a49a2a619bc1564, user_id=35b6c729749d44ad9469abae2ddd6c2b, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.060556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f26144-3ed0-4a7b-8265-6e5926abf5f7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.083654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1186/2388] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:33 2022] PUT /identity/v3/projects/33c0e3f390ca49098a49a2a619bc1564/users/35b6c729749d44ad9469abae2ddd6c2b/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:33.096869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b36caf-4b8b-4c0d-988b-c997efca8758 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.097146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b36caf-4b8b-4c0d-988b-c997efca8758 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.097427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b36caf-4b8b-4c0d-988b-c997efca8758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.131440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c5b36caf-4b8b-4c0d-988b-c997efca8758 None None] MFA Rules not processed for user `35b6c729749d44ad9469abae2ddd6c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:33.133021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c5b36caf-4b8b-4c0d-988b-c997efca8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:33.223080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1203/2389] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:22:33.228387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26144-3ed0-4a7b-8265-6e5926abf5f7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.320082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26144-3ed0-4a7b-8265-6e5926abf5f7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.325048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41089cc-1eb4-4f08-97c6-74970219d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.325663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41089cc-1eb4-4f08-97c6-74970219d89a admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.325945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41089cc-1eb4-4f08-97c6-74970219d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.326221 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41089cc-1eb4-4f08-97c6-74970219d89a admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.326890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41089cc-1eb4-4f08-97c6-74970219d89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.328819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41089cc-1eb4-4f08-97c6-74970219d89a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.360696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1187/2390] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:33 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:33.364978 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b36caf-4b8b-4c0d-988b-c997efca8758 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.377670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b36caf-4b8b-4c0d-988b-c997efca8758 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.454575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92dc78-a583-493f-98fa-dc1b06577ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.455115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92dc78-a583-493f-98fa-dc1b06577ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.455402 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92dc78-a583-493f-98fa-dc1b06577ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.455777 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92dc78-a583-493f-98fa-dc1b06577ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.456571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92dc78-a583-493f-98fa-dc1b06577ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.458655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92dc78-a583-493f-98fa-dc1b06577ae5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.488579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1204/2391] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:33 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:33.493238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41089cc-1eb4-4f08-97c6-74970219d89a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.504219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41089cc-1eb4-4f08-97c6-74970219d89a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.509213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ff26-9071-451b-812e-1da576e61e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.509823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff26-9071-451b-812e-1da576e61e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.510110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff26-9071-451b-812e-1da576e61e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.510433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff26-9071-451b-812e-1da576e61e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.511083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9ff26-9071-451b-812e-1da576e61e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.513081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9ff26-9071-451b-812e-1da576e61e73 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.524473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1188/2392] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:33.530679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92dc78-a583-493f-98fa-dc1b06577ae5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.541376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92dc78-a583-493f-98fa-dc1b06577ae5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.547217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b2af-ef27-4b52-94a4-bfc50b6182ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.547900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b2af-ef27-4b52-94a4-bfc50b6182ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.548179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b2af-ef27-4b52-94a4-bfc50b6182ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.548456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491b2af-ef27-4b52-94a4-bfc50b6182ec admin admin] PATH_INFO: `/v3/projects/904f68bfb3f84a15b57565fe22f8487a/users/03b3d9ceb90c4853a347f518a14b050e/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.569479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491b2af-ef27-4b52-94a4-bfc50b6182ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=904f68bfb3f84a15b57565fe22f8487a, user_id=03b3d9ceb90c4853a347f518a14b050e, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.572273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491b2af-ef27-4b52-94a4-bfc50b6182ec admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.588235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1205/2393] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:33 2022] PUT /identity/v3/projects/904f68bfb3f84a15b57565fe22f8487a/users/03b3d9ceb90c4853a347f518a14b050e/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:33.593503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ff26-9071-451b-812e-1da576e61e73 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.606841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ff26-9071-451b-812e-1da576e61e73 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.642716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:33.677001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb704d2-0128-4963-bd06-35e09a9d9723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.677631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb704d2-0128-4963-bd06-35e09a9d9723 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.677911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb704d2-0128-4963-bd06-35e09a9d9723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.678190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb704d2-0128-4963-bd06-35e09a9d9723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.678892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb704d2-0128-4963-bd06-35e09a9d9723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.680530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb704d2-0128-4963-bd06-35e09a9d9723 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.692059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1189/2394] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:33.696815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b2af-ef27-4b52-94a4-bfc50b6182ec admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.708791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491b2af-ef27-4b52-94a4-bfc50b6182ec admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.713983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.714782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.715063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.715370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] PATH_INFO: `/v3/projects/904f68bfb3f84a15b57565fe22f8487a/users/03b3d9ceb90c4853a347f518a14b050e/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.717325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=904f68bfb3f84a15b57565fe22f8487a, user_id=03b3d9ceb90c4853a347f518a14b050e, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.720041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.732103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1206/2395] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:33 2022] PUT /identity/v3/projects/904f68bfb3f84a15b57565fe22f8487a/users/03b3d9ceb90c4853a347f518a14b050e/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:33.742555 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766da-bef0-40b7-ab33-ce3132cbff9b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.742828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766da-bef0-40b7-ab33-ce3132cbff9b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.743263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766da-bef0-40b7-ab33-ce3132cbff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.776236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8a7766da-bef0-40b7-ab33-ce3132cbff9b None None] MFA Rules not processed for user `03b3d9ceb90c4853a347f518a14b050e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:33.777838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8a7766da-bef0-40b7-ab33-ce3132cbff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:33.876429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1190/2396] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:22:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:33.888871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.892373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:33.937031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:33.970007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4911a-0d0b-4b1c-a1b6-d459c28550b1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.973995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f7c0-8a62-441d-84b9-c7ac54a1d102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.974642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f7c0-8a62-441d-84b9-c7ac54a1d102 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.974929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f7c0-8a62-441d-84b9-c7ac54a1d102 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.975195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f7c0-8a62-441d-84b9-c7ac54a1d102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.992919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9f7c0-8a62-441d-84b9-c7ac54a1d102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.992919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9f7c0-8a62-441d-84b9-c7ac54a1d102 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:34.006950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1207/2397] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:34.088371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7766da-bef0-40b7-ab33-ce3132cbff9b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:34.100089 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7766da-bef0-40b7-ab33-ce3132cbff9b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:34.104369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3b085-759b-4cec-96e9-32df33127385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:34.104989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3b085-759b-4cec-96e9-32df33127385 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:34.105278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3b085-759b-4cec-96e9-32df33127385 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:34.105554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3b085-759b-4cec-96e9-32df33127385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:34.172638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3b085-759b-4cec-96e9-32df33127385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:34.174152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3b085-759b-4cec-96e9-32df33127385 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:34.185912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1191/2398] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:22:43.998423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=13 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:44.179897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=77 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:13.521004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f7c0-8a62-441d-84b9-c7ac54a1d102 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:13.588595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f7c0-8a62-441d-84b9-c7ac54a1d102 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:13.593310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:13.593934 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:13.594214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:13.594520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] PATH_INFO: `/v3/users/35b6c729749d44ad9469abae2ddd6c2b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:13.595646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b6c729749d44ad9469abae2ddd6c2b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:13.598018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:13.648928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b6c729749d44ad9469abae2ddd6c2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:13.655757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b6c729749d44ad9469abae2ddd6c2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:13.656432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b6c729749d44ad9469abae2ddd6c2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:13.663703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b6c729749d44ad9469abae2ddd6c2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:13.664485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b6c729749d44ad9469abae2ddd6c2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:13.681969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1208/2399] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:13 2022] DELETE /identity/v3/users/35b6c729749d44ad9469abae2ddd6c2b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:13.686633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58fa24-f4f1-4867-89e8-2f369bf49742 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:13.687150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58fa24-f4f1-4867-89e8-2f369bf49742 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:13.687260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58fa24-f4f1-4867-89e8-2f369bf49742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:13.708124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0e58fa24-f4f1-4867-89e8-2f369bf49742 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:13.709334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0e58fa24-f4f1-4867-89e8-2f369bf49742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:13.772841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1192/2400] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:23:13.782524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:13.784715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:13.858706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ddd91-8eae-4201-8c86-dbc61dd2e05d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:13.863334 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415c372-b1f2-436e-881f-9e37f2cc575c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:13.863796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415c372-b1f2-436e-881f-9e37f2cc575c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:13.864144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415c372-b1f2-436e-881f-9e37f2cc575c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:13.864696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415c372-b1f2-436e-881f-9e37f2cc575c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:13.875090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415c372-b1f2-436e-881f-9e37f2cc575c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:13.878219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415c372-b1f2-436e-881f-9e37f2cc575c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:13.887838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1209/2401] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:14.171771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58fa24-f4f1-4867-89e8-2f369bf49742 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:14.174925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0e58fa24-f4f1-4867-89e8-2f369bf49742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:14.209390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58fa24-f4f1-4867-89e8-2f369bf49742 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:14.220141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:14.220991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:14.221433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:14.221941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] PATH_INFO: `/v3/projects/33c0e3f390ca49098a49a2a619bc1564` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:14.224556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c0e3f390ca49098a49a2a619bc1564)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:14.227674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:14.291187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c0e3f390ca49098a49a2a619bc1564', 'request_id': 'req-71d98b01-3efd-448e-b77f-04c714c9aba7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.302305 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c0e3f390ca49098a49a2a619bc1564', 'request_id': 'req-71d98b01-3efd-448e-b77f-04c714c9aba7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.314432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c0e3f390ca49098a49a2a619bc1564', 'request_id': 'req-71d98b01-3efd-448e-b77f-04c714c9aba7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.327824 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] The token cache is being invalidate because project 33c0e3f390ca49098a49a2a619bc1564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:14.328187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.328914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.330533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1193/2402] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:14 2022] DELETE /identity/v3/projects/33c0e3f390ca49098a49a2a619bc1564 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:14.334630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415c372-b1f2-436e-881f-9e37f2cc575c service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:14.344628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415c372-b1f2-436e-881f-9e37f2cc575c service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:14.363512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:14.404696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:14.405323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:14.405605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:14.405884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] PATH_INFO: `/v3/users/03b3d9ceb90c4853a347f518a14b050e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:14.407044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b3d9ceb90c4853a347f518a14b050e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:14.409018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:14.454095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b3d9ceb90c4853a347f518a14b050e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.461271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b3d9ceb90c4853a347f518a14b050e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.461936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b3d9ceb90c4853a347f518a14b050e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.470023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b3d9ceb90c4853a347f518a14b050e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.471490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dfd7cf89-d6ec-47c2-bf3f-293120b806be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b3d9ceb90c4853a347f518a14b050e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.490046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1210/2403] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:14 2022] DELETE /identity/v3/users/03b3d9ceb90c4853a347f518a14b050e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:23:14.769345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:14.771387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:14.786352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d98b01-3efd-448e-b77f-04c714c9aba7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:14.851771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:14.852915 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:14.853431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:14.853942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] PATH_INFO: `/v3/projects/904f68bfb3f84a15b57565fe22f8487a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:14.856027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=904f68bfb3f84a15b57565fe22f8487a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:14.859878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:14.901101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:14.924460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '904f68bfb3f84a15b57565fe22f8487a', 'request_id': 'req-63dbdde7-76de-4afa-9000-1ddbcb259a71'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.931528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '904f68bfb3f84a15b57565fe22f8487a', 'request_id': 'req-63dbdde7-76de-4afa-9000-1ddbcb259a71'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.941613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '904f68bfb3f84a15b57565fe22f8487a', 'request_id': 'req-63dbdde7-76de-4afa-9000-1ddbcb259a71'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.962427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] The token cache is being invalidate because project 904f68bfb3f84a15b57565fe22f8487a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:14.962768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.963469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-63dbdde7-76de-4afa-9000-1ddbcb259a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:14.965449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1194/2404] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:14 2022] DELETE /identity/v3/projects/904f68bfb3f84a15b57565fe22f8487a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:23:14.971516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46a5a8-6afa-40c7-8e3d-7802ba86a6eb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:14.972082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46a5a8-6afa-40c7-8e3d-7802ba86a6eb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:14.972500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46a5a8-6afa-40c7-8e3d-7802ba86a6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:14.995680 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7e46a5a8-6afa-40c7-8e3d-7802ba86a6eb None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:14.997775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e46a5a8-6afa-40c7-8e3d-7802ba86a6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:15.062469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1211/2405] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:23:15.072066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2b7b-3833-4178-96df-bf13d572460e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.072346 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2b7b-3833-4178-96df-bf13d572460e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.072621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2b7b-3833-4178-96df-bf13d572460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.094576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c97c2b7b-3833-4178-96df-bf13d572460e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:15.096386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c97c2b7b-3833-4178-96df-bf13d572460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:15.104425 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1195/2406] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:15.109033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46a5a8-6afa-40c7-8e3d-7802ba86a6eb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.120030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46a5a8-6afa-40c7-8e3d-7802ba86a6eb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.125075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.125823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.126229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.126553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.127377 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:23:15.127684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.129321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.141613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1212/2407] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:23:15.147238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c2b7b-3833-4178-96df-bf13d572460e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.156322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c2b7b-3833-4178-96df-bf13d572460e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.161649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd752-c656-4e49-a6f2-dcf217f67bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.162275 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd752-c656-4e49-a6f2-dcf217f67bee admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.162567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd752-c656-4e49-a6f2-dcf217f67bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.162842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd752-c656-4e49-a6f2-dcf217f67bee admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.163475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd752-c656-4e49-a6f2-dcf217f67bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.165376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd752-c656-4e49-a6f2-dcf217f67bee admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.194926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1196/2408] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:15 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:15.199696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.215219 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc991ee-aee0-42fd-8688-56680df124ef admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.252713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:15.298762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ce72-a329-4df2-a3fd-3e68f3869aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.300815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ce72-a329-4df2-a3fd-3e68f3869aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.301321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ce72-a329-4df2-a3fd-3e68f3869aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.302623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993ce72-a329-4df2-a3fd-3e68f3869aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.303165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993ce72-a329-4df2-a3fd-3e68f3869aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.305422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993ce72-a329-4df2-a3fd-3e68f3869aa8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.331931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1213/2409] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:15 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:23:15.336576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd752-c656-4e49-a6f2-dcf217f67bee admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.353012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd752-c656-4e49-a6f2-dcf217f67bee admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.362494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac1ce-7261-479e-ba21-f888fb9fc84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.363890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac1ce-7261-479e-ba21-f888fb9fc84b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.364162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac1ce-7261-479e-ba21-f888fb9fc84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.364486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac1ce-7261-479e-ba21-f888fb9fc84b admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.366148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac1ce-7261-479e-ba21-f888fb9fc84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.369434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac1ce-7261-479e-ba21-f888fb9fc84b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.396695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1197/2410] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:15.401867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ce72-a329-4df2-a3fd-3e68f3869aa8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.426939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993ce72-a329-4df2-a3fd-3e68f3869aa8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.432042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723dce0-de1a-4bcc-9854-a0eefbfabc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.432677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723dce0-de1a-4bcc-9854-a0eefbfabc12 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.432959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723dce0-de1a-4bcc-9854-a0eefbfabc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.433241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723dce0-de1a-4bcc-9854-a0eefbfabc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.433894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723dce0-de1a-4bcc-9854-a0eefbfabc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.435531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723dce0-de1a-4bcc-9854-a0eefbfabc12 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.448772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1214/2411] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:15.452712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac1ce-7261-479e-ba21-f888fb9fc84b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.464115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac1ce-7261-479e-ba21-f888fb9fc84b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.478075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a016fb6-92e8-4a0d-add4-fd9dc3a0a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.478946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a016fb6-92e8-4a0d-add4-fd9dc3a0a218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.479300 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a016fb6-92e8-4a0d-add4-fd9dc3a0a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.479682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a016fb6-92e8-4a0d-add4-fd9dc3a0a218 admin admin] PATH_INFO: `/v3/projects/3dba95b7f7054f11ae5c8e8c7f44a4c9/users/195130c14c4147b3817bfaa8387e937a/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.497485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a016fb6-92e8-4a0d-add4-fd9dc3a0a218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dba95b7f7054f11ae5c8e8c7f44a4c9, user_id=195130c14c4147b3817bfaa8387e937a, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.500450 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a016fb6-92e8-4a0d-add4-fd9dc3a0a218 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.518488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1198/2412] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:15 2022] PUT /identity/v3/projects/3dba95b7f7054f11ae5c8e8c7f44a4c9/users/195130c14c4147b3817bfaa8387e937a/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:23:15.528690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b7a3-afe8-41be-b4d5-a6e3cecfa4dd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.529111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b7a3-afe8-41be-b4d5-a6e3cecfa4dd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.529489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1b7a3-afe8-41be-b4d5-a6e3cecfa4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.560888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f2b1b7a3-afe8-41be-b4d5-a6e3cecfa4dd None None] MFA Rules not processed for user `195130c14c4147b3817bfaa8387e937a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:15.562101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f2b1b7a3-afe8-41be-b4d5-a6e3cecfa4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:15.641387 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1215/2413] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:15.646493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a016fb6-92e8-4a0d-add4-fd9dc3a0a218 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.710588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a016fb6-92e8-4a0d-add4-fd9dc3a0a218 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.715182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b5e4-03da-4b46-a851-50397accda00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.715791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5e4-03da-4b46-a851-50397accda00 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.716069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5e4-03da-4b46-a851-50397accda00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.716347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5e4-03da-4b46-a851-50397accda00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.716980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b5e4-03da-4b46-a851-50397accda00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.718955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b5e4-03da-4b46-a851-50397accda00 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.746688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1199/2414] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:15 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:15.750993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1b7a3-afe8-41be-b4d5-a6e3cecfa4dd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.762247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1b7a3-afe8-41be-b4d5-a6e3cecfa4dd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.819784 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d68f1c-56f2-4a4b-9612-49b6523a5ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.820392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d68f1c-56f2-4a4b-9612-49b6523a5ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.820673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d68f1c-56f2-4a4b-9612-49b6523a5ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.820947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d68f1c-56f2-4a4b-9612-49b6523a5ffd admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.821576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d68f1c-56f2-4a4b-9612-49b6523a5ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.823524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d68f1c-56f2-4a4b-9612-49b6523a5ffd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.847011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1216/2415] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:15 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:15.851226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b5e4-03da-4b46-a851-50397accda00 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.861880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b5e4-03da-4b46-a851-50397accda00 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.867188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e732bc1-3a8d-4394-8424-c1364c1993b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.867799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e732bc1-3a8d-4394-8424-c1364c1993b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.868082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e732bc1-3a8d-4394-8424-c1364c1993b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.868354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e732bc1-3a8d-4394-8424-c1364c1993b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.868999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e732bc1-3a8d-4394-8424-c1364c1993b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.870651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e732bc1-3a8d-4394-8424-c1364c1993b9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.881840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1200/2416] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:15.886366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d68f1c-56f2-4a4b-9612-49b6523a5ffd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.897892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d68f1c-56f2-4a4b-9612-49b6523a5ffd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.902882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a45f8a-a3b8-4b97-88aa-7f31c6208a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.903590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45f8a-a3b8-4b97-88aa-7f31c6208a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.903875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45f8a-a3b8-4b97-88aa-7f31c6208a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.904162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45f8a-a3b8-4b97-88aa-7f31c6208a24 admin admin] PATH_INFO: `/v3/projects/1d9ddb093a2740559ac7d44f5130055a/users/38346a3496074c72aa71de2ed6c4ff05/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.921438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a45f8a-a3b8-4b97-88aa-7f31c6208a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9ddb093a2740559ac7d44f5130055a, user_id=38346a3496074c72aa71de2ed6c4ff05, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.924305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a45f8a-a3b8-4b97-88aa-7f31c6208a24 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.938829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1217/2417] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:15 2022] PUT /identity/v3/projects/1d9ddb093a2740559ac7d44f5130055a/users/38346a3496074c72aa71de2ed6c4ff05/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:15.944446 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e732bc1-3a8d-4394-8424-c1364c1993b9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.956067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e732bc1-3a8d-4394-8424-c1364c1993b9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.978553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:16.031936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543be67-8466-476d-9d6d-7c6a29ddf613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:16.033040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543be67-8466-476d-9d6d-7c6a29ddf613 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:16.034732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543be67-8466-476d-9d6d-7c6a29ddf613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:16.035224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543be67-8466-476d-9d6d-7c6a29ddf613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:16.036456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543be67-8466-476d-9d6d-7c6a29ddf613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:16.039334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543be67-8466-476d-9d6d-7c6a29ddf613 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:16.059693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1201/2418] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:16.063695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a45f8a-a3b8-4b97-88aa-7f31c6208a24 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:16.071702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:16.080747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a45f8a-a3b8-4b97-88aa-7f31c6208a24 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:16.088264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:16.089233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:16.089675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:16.090121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] PATH_INFO: `/v3/projects/1d9ddb093a2740559ac7d44f5130055a/users/38346a3496074c72aa71de2ed6c4ff05/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:16.092625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9ddb093a2740559ac7d44f5130055a, user_id=38346a3496074c72aa71de2ed6c4ff05, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:16.096214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:16.109018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1218/2419] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:16 2022] PUT /identity/v3/projects/1d9ddb093a2740559ac7d44f5130055a/users/38346a3496074c72aa71de2ed6c4ff05/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:16.129681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516bfa-0db6-45d9-b2bf-eee7e214caf2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:16.130444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516bfa-0db6-45d9-b2bf-eee7e214caf2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:16.131067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516bfa-0db6-45d9-b2bf-eee7e214caf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:16.172216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-77516bfa-0db6-45d9-b2bf-eee7e214caf2 None None] MFA Rules not processed for user `38346a3496074c72aa71de2ed6c4ff05`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:16.173507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-77516bfa-0db6-45d9-b2bf-eee7e214caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:16.251662 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1202/2420] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:16.263429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:16.265250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:16.326793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e71d2b-ede3-45d6-b96f-eb4252a7956a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:16.331052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38799e-9644-4796-9f35-2a5fed94157a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:16.331692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38799e-9644-4796-9f35-2a5fed94157a service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:16.331967 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38799e-9644-4796-9f35-2a5fed94157a service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:16.332236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38799e-9644-4796-9f35-2a5fed94157a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:16.342812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38799e-9644-4796-9f35-2a5fed94157a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:16.344268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38799e-9644-4796-9f35-2a5fed94157a service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:16.355520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1219/2421] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:16.455588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516bfa-0db6-45d9-b2bf-eee7e214caf2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:16.466099 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516bfa-0db6-45d9-b2bf-eee7e214caf2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:16.473842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fabcb4-415d-4dbb-8a07-c307f63ed109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:16.474816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fabcb4-415d-4dbb-8a07-c307f63ed109 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:16.474934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fabcb4-415d-4dbb-8a07-c307f63ed109 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:16.475282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fabcb4-415d-4dbb-8a07-c307f63ed109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:16.587361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fabcb4-415d-4dbb-8a07-c307f63ed109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:16.588950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fabcb4-415d-4dbb-8a07-c307f63ed109 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:16.601905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1203/2422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:19.438284 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38799e-9644-4796-9f35-2a5fed94157a service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:19.529526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38799e-9644-4796-9f35-2a5fed94157a service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:19.534590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:19.535138 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:19.535419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:19.535689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] PATH_INFO: `/v3/users/195130c14c4147b3817bfaa8387e937a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:19.536942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195130c14c4147b3817bfaa8387e937a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:19.538953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:19.597107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195130c14c4147b3817bfaa8387e937a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:19.604800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195130c14c4147b3817bfaa8387e937a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:19.605485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195130c14c4147b3817bfaa8387e937a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:19.614558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195130c14c4147b3817bfaa8387e937a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:19.614558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195130c14c4147b3817bfaa8387e937a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:19.633327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1220/2423] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:19 2022] DELETE /identity/v3/users/195130c14c4147b3817bfaa8387e937a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:19.638438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1feb3-7d1b-4883-8f13-1a1bb73ed1d4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:19.638986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1feb3-7d1b-4883-8f13-1a1bb73ed1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:19.639082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1feb3-7d1b-4883-8f13-1a1bb73ed1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:19.658398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-75b1feb3-7d1b-4883-8f13-1a1bb73ed1d4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:19.659629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-75b1feb3-7d1b-4883-8f13-1a1bb73ed1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:19.703921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:19.723724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1204/2424] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:19.733418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:19.734871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:19.749361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:19.804990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df941633-0b79-415e-aab7-befe904c41e1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:19.809106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e005a-5598-4552-b950-740f82187803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:19.809853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e005a-5598-4552-b950-740f82187803 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:19.810172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e005a-5598-4552-b950-740f82187803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:19.810460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e005a-5598-4552-b950-740f82187803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:19.824701 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e005a-5598-4552-b950-740f82187803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:19.826165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e005a-5598-4552-b950-740f82187803 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:19.837725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1221/2425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:20.243001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1feb3-7d1b-4883-8f13-1a1bb73ed1d4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:20.244445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-75b1feb3-7d1b-4883-8f13-1a1bb73ed1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:20.256971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1feb3-7d1b-4883-8f13-1a1bb73ed1d4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:20.261696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:20.262369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.262653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.262934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] PATH_INFO: `/v3/projects/3dba95b7f7054f11ae5c8e8c7f44a4c9` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.264178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dba95b7f7054f11ae5c8e8c7f44a4c9)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:20.266096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:20.328778 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dba95b7f7054f11ae5c8e8c7f44a4c9', 'request_id': 'req-53985599-e89f-49db-ae82-e5e08fa8cd03'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.336310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dba95b7f7054f11ae5c8e8c7f44a4c9', 'request_id': 'req-53985599-e89f-49db-ae82-e5e08fa8cd03'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.346238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dba95b7f7054f11ae5c8e8c7f44a4c9', 'request_id': 'req-53985599-e89f-49db-ae82-e5e08fa8cd03'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.357494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] The token cache is being invalidate because project 3dba95b7f7054f11ae5c8e8c7f44a4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:20.357792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.358506 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.360041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1205/2426] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:20 2022] DELETE /identity/v3/projects/3dba95b7f7054f11ae5c8e8c7f44a4c9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:20.364424 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e005a-5598-4552-b950-740f82187803 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:20.374488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e005a-5598-4552-b950-740f82187803 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:20.434357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:20.434926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.435206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.435507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] PATH_INFO: `/v3/users/38346a3496074c72aa71de2ed6c4ff05` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.436661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38346a3496074c72aa71de2ed6c4ff05)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:20.438653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:20.492582 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38346a3496074c72aa71de2ed6c4ff05'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.501535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38346a3496074c72aa71de2ed6c4ff05'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.502361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38346a3496074c72aa71de2ed6c4ff05'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.511386 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38346a3496074c72aa71de2ed6c4ff05'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.512069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e8b2cfa4-683a-4f9b-8de3-b9a49d023f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38346a3496074c72aa71de2ed6c4ff05'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.531606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1222/2427] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:20 2022] DELETE /identity/v3/users/38346a3496074c72aa71de2ed6c4ff05 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:20.844960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:20.848128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:20.869187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53985599-e89f-49db-ae82-e5e08fa8cd03 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:20.936944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:20.937501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.937779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.938202 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] PATH_INFO: `/v3/projects/1d9ddb093a2740559ac7d44f5130055a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.939460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9ddb093a2740559ac7d44f5130055a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:20.941527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:20.998728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9ddb093a2740559ac7d44f5130055a', 'request_id': 'req-fc82c880-93e1-40eb-b56e-110475f9d165'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:21.008079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9ddb093a2740559ac7d44f5130055a', 'request_id': 'req-fc82c880-93e1-40eb-b56e-110475f9d165'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:21.019043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9ddb093a2740559ac7d44f5130055a', 'request_id': 'req-fc82c880-93e1-40eb-b56e-110475f9d165'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:21.029277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:21.037118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] The token cache is being invalidate because project 1d9ddb093a2740559ac7d44f5130055a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:21.037653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:21.039018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fc82c880-93e1-40eb-b56e-110475f9d165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:21.040703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1206/2428] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:20 2022] DELETE /identity/v3/projects/1d9ddb093a2740559ac7d44f5130055a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:21.046467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9253-c67c-4421-ab10-e4e117054463 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.046754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9253-c67c-4421-ab10-e4e117054463 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.047022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f9253-c67c-4421-ab10-e4e117054463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.068696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-509f9253-c67c-4421-ab10-e4e117054463 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:21.069921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-509f9253-c67c-4421-ab10-e4e117054463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:21.112684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:21.152646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1223/2429] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:21.161718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e3e6-c6da-4036-ad3f-eb19324005e2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.162121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e3e6-c6da-4036-ad3f-eb19324005e2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.162518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e3e6-c6da-4036-ad3f-eb19324005e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.184947 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-ed94e3e6-c6da-4036-ad3f-eb19324005e2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:21.186299 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ed94e3e6-c6da-4036-ad3f-eb19324005e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:21.200610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1207/2430] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:21.205763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f9253-c67c-4421-ab10-e4e117054463 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.216760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f9253-c67c-4421-ab10-e4e117054463 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.222591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.223370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.223524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.223802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.224464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:23:21.224768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.226437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.241111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1224/2431] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:23:21.246684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94e3e6-c6da-4036-ad3f-eb19324005e2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.264855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94e3e6-c6da-4036-ad3f-eb19324005e2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.273633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b989acb-7940-4a5c-94cf-c28d7dcf1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.274744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b989acb-7940-4a5c-94cf-c28d7dcf1be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.275261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b989acb-7940-4a5c-94cf-c28d7dcf1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.275758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b989acb-7940-4a5c-94cf-c28d7dcf1be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.276941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b989acb-7940-4a5c-94cf-c28d7dcf1be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.280927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b989acb-7940-4a5c-94cf-c28d7dcf1be3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.329395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1208/2432] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:23:21.331278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.342388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad9466-8584-480b-8eb5-1f7567b551f5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.410380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6549-bbaf-49c4-abad-8c0fcde19edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.411050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6549-bbaf-49c4-abad-8c0fcde19edd admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.411352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6549-bbaf-49c4-abad-8c0fcde19edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.411584 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6549-bbaf-49c4-abad-8c0fcde19edd admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.412226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6549-bbaf-49c4-abad-8c0fcde19edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.414426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6549-bbaf-49c4-abad-8c0fcde19edd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.437619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1225/2433] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:23:21.441980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b989acb-7940-4a5c-94cf-c28d7dcf1be3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.453064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b989acb-7940-4a5c-94cf-c28d7dcf1be3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.457887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d65d-ce23-4da4-b509-a405a1a3fbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.458533 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d65d-ce23-4da4-b509-a405a1a3fbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.458813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d65d-ce23-4da4-b509-a405a1a3fbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.459088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302d65d-ce23-4da4-b509-a405a1a3fbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.459731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302d65d-ce23-4da4-b509-a405a1a3fbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.461582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302d65d-ce23-4da4-b509-a405a1a3fbf3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.472669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1209/2434] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:21.476891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6549-bbaf-49c4-abad-8c0fcde19edd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.487992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6549-bbaf-49c4-abad-8c0fcde19edd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.492660 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554151-9ca1-4fcd-9362-ee74a9623780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.493260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554151-9ca1-4fcd-9362-ee74a9623780 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.493541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554151-9ca1-4fcd-9362-ee74a9623780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.493820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554151-9ca1-4fcd-9362-ee74a9623780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.494510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b554151-9ca1-4fcd-9362-ee74a9623780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.496115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b554151-9ca1-4fcd-9362-ee74a9623780 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.507473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1226/2435] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:21.512469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d65d-ce23-4da4-b509-a405a1a3fbf3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.522772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302d65d-ce23-4da4-b509-a405a1a3fbf3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.527437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f4f5-3555-461e-ba8d-690063aeaec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.528098 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f4f5-3555-461e-ba8d-690063aeaec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.528384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f4f5-3555-461e-ba8d-690063aeaec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.528663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f4f5-3555-461e-ba8d-690063aeaec5 admin admin] PATH_INFO: `/v3/projects/aa7aaea595e14111a5022167984d663f/users/f60c1b4290f147a295dea7312cd0f791/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.544943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413f4f5-3555-461e-ba8d-690063aeaec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7aaea595e14111a5022167984d663f, user_id=f60c1b4290f147a295dea7312cd0f791, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.547670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413f4f5-3555-461e-ba8d-690063aeaec5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.561701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1210/2436] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:21 2022] PUT /identity/v3/projects/aa7aaea595e14111a5022167984d663f/users/f60c1b4290f147a295dea7312cd0f791/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:21.577713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b53da-0549-4c23-ad97-4676cb969430 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.578011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b53da-0549-4c23-ad97-4676cb969430 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.578251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b53da-0549-4c23-ad97-4676cb969430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.609950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-470b53da-0549-4c23-ad97-4676cb969430 None None] MFA Rules not processed for user `f60c1b4290f147a295dea7312cd0f791`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:21.611221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-470b53da-0549-4c23-ad97-4676cb969430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:21.691296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1227/2437] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:21.696430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f4f5-3555-461e-ba8d-690063aeaec5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.779165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f4f5-3555-461e-ba8d-690063aeaec5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.785047 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47f742-21ad-4579-af51-a88c52c3550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.785870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f742-21ad-4579-af51-a88c52c3550a admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.786328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f742-21ad-4579-af51-a88c52c3550a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.786538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f742-21ad-4579-af51-a88c52c3550a admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.787237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47f742-21ad-4579-af51-a88c52c3550a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.789282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47f742-21ad-4579-af51-a88c52c3550a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.824196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1211/2438] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:21.829994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b53da-0549-4c23-ad97-4676cb969430 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.841813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b53da-0549-4c23-ad97-4676cb969430 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.870075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:21.905907 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9d91-de58-4222-87dc-0f35fe63d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.906571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9d91-de58-4222-87dc-0f35fe63d319 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.906856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9d91-de58-4222-87dc-0f35fe63d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.907161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9d91-de58-4222-87dc-0f35fe63d319 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.907799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb9d91-de58-4222-87dc-0f35fe63d319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.910485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb9d91-de58-4222-87dc-0f35fe63d319 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.933111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1228/2439] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:21.940154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47f742-21ad-4579-af51-a88c52c3550a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.956835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47f742-21ad-4579-af51-a88c52c3550a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.962582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af7a3-62e2-4755-9e0c-47ad80af3e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.963262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af7a3-62e2-4755-9e0c-47ad80af3e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.963594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af7a3-62e2-4755-9e0c-47ad80af3e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.963917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af7a3-62e2-4755-9e0c-47ad80af3e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.964636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af7a3-62e2-4755-9e0c-47ad80af3e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.966489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af7a3-62e2-4755-9e0c-47ad80af3e1a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.980844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1212/2440] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:21.985075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9d91-de58-4222-87dc-0f35fe63d319 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.995933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9d91-de58-4222-87dc-0f35fe63d319 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:22.000963 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735413-248c-4121-9332-f5e8a6447d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:22.002205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735413-248c-4121-9332-f5e8a6447d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:22.002629 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735413-248c-4121-9332-f5e8a6447d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:22.002913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735413-248c-4121-9332-f5e8a6447d9d admin admin] PATH_INFO: `/v3/projects/f8a11abfc2e0450db7491b481b44b506/users/5e2eb7a31c0e472097cfd528e647db01/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:22.019836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd735413-248c-4121-9332-f5e8a6447d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a11abfc2e0450db7491b481b44b506, user_id=5e2eb7a31c0e472097cfd528e647db01, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:22.022934 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd735413-248c-4121-9332-f5e8a6447d9d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:22.038532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1229/2441] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:21 2022] PUT /identity/v3/projects/f8a11abfc2e0450db7491b481b44b506/users/5e2eb7a31c0e472097cfd528e647db01/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:22.041372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af7a3-62e2-4755-9e0c-47ad80af3e1a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:22.056563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af7a3-62e2-4755-9e0c-47ad80af3e1a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:22.138870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f672f-cad5-4bec-afef-c0db43686518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:22.138870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f672f-cad5-4bec-afef-c0db43686518 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:22.139282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f672f-cad5-4bec-afef-c0db43686518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:22.139631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f672f-cad5-4bec-afef-c0db43686518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:22.140349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f672f-cad5-4bec-afef-c0db43686518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:22.142078 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f672f-cad5-4bec-afef-c0db43686518 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:22.153240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1213/2442] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:22.172791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735413-248c-4121-9332-f5e8a6447d9d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:22.186043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735413-248c-4121-9332-f5e8a6447d9d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:22.191915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:22.192618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:22.192896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:22.193194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] PATH_INFO: `/v3/projects/f8a11abfc2e0450db7491b481b44b506/users/5e2eb7a31c0e472097cfd528e647db01/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:22.195634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a11abfc2e0450db7491b481b44b506, user_id=5e2eb7a31c0e472097cfd528e647db01, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:22.198359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:22.213399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1230/2443] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:22 2022] PUT /identity/v3/projects/f8a11abfc2e0450db7491b481b44b506/users/5e2eb7a31c0e472097cfd528e647db01/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:22.229515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363075d-214f-4e80-b2c2-3872432610bb None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:22.229804 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363075d-214f-4e80-b2c2-3872432610bb None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:22.230086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363075d-214f-4e80-b2c2-3872432610bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:22.241008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:22.288314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5363075d-214f-4e80-b2c2-3872432610bb None None] MFA Rules not processed for user `5e2eb7a31c0e472097cfd528e647db01`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:22.290003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5363075d-214f-4e80-b2c2-3872432610bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:22.448542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1214/2444] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:22.474464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:22.476094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:22.577115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848caf-4f25-4003-9842-77402cafb670 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:22.583652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:22.584399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:22.584731 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:22.585041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:22.655300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:22.657281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:22.668588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1231/2445] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:23:27.511201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363075d-214f-4e80-b2c2-3872432610bb None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:27.520797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363075d-214f-4e80-b2c2-3872432610bb None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:27.524356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283300-70f7-4b27-95e1-cbb018145186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:27.524944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283300-70f7-4b27-95e1-cbb018145186 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:27.525222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283300-70f7-4b27-95e1-cbb018145186 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:27.525493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283300-70f7-4b27-95e1-cbb018145186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:27.536125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84283300-70f7-4b27-95e1-cbb018145186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:27.537535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84283300-70f7-4b27-95e1-cbb018145186 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:27.547121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1215/2446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:32.663319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:37.542938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=38 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:50.115954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:50.117275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:50.298509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b56ae0-b8ba-41cf-a332-8a0b40a591b5 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:50.304666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0afe6-a798-421a-9948-21ec16768e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:50.305508 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0afe6-a798-421a-9948-21ec16768e47 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:50.305643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0afe6-a798-421a-9948-21ec16768e47 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:50.305830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0afe6-a798-421a-9948-21ec16768e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:50.307844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-63f0afe6-a798-421a-9948-21ec16768e47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:50.371157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0afe6-a798-421a-9948-21ec16768e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:50.372672 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0afe6-a798-421a-9948-21ec16768e47 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:50.383350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1232/2447] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:50.481363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283300-70f7-4b27-95e1-cbb018145186 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:50.600742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283300-70f7-4b27-95e1-cbb018145186 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:50.605783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:50.606467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:50.606750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:50.607027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] PATH_INFO: `/v3/users/f60c1b4290f147a295dea7312cd0f791` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:50.608187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60c1b4290f147a295dea7312cd0f791)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:50.610163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:50.661141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60c1b4290f147a295dea7312cd0f791'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:50.668057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60c1b4290f147a295dea7312cd0f791'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:50.668738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60c1b4290f147a295dea7312cd0f791'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:50.678354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60c1b4290f147a295dea7312cd0f791'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:50.691502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60c1b4290f147a295dea7312cd0f791'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:50.697439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1216/2448] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:50 2022] DELETE /identity/v3/users/f60c1b4290f147a295dea7312cd0f791 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:50.701991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8fa26-4c39-4039-ab38-85cadb62d086 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:50.702287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8fa26-4c39-4039-ab38-85cadb62d086 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:50.702684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8fa26-4c39-4039-ab38-85cadb62d086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:50.734877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:50.743640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c1e8fa26-4c39-4039-ab38-85cadb62d086 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:50.744844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c1e8fa26-4c39-4039-ab38-85cadb62d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:50.811370 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1233/2449] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:50.821210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:50.822825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:50.869507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:50.887134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac718b4-e18e-4beb-8102-d22d91dc2309 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:50.890649 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435fe8a-b2eb-4e80-bef5-fb636cf9f472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:50.891255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435fe8a-b2eb-4e80-bef5-fb636cf9f472 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:50.891536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435fe8a-b2eb-4e80-bef5-fb636cf9f472 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:50.891848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435fe8a-b2eb-4e80-bef5-fb636cf9f472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:50.902890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435fe8a-b2eb-4e80-bef5-fb636cf9f472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:50.904319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435fe8a-b2eb-4e80-bef5-fb636cf9f472 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:50.914103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1217/2450] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:51.178171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8fa26-4c39-4039-ab38-85cadb62d086 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:51.179725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c1e8fa26-4c39-4039-ab38-85cadb62d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:51.192783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8fa26-4c39-4039-ab38-85cadb62d086 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:51.197501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:51.198128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:51.198439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:51.198737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] PATH_INFO: `/v3/projects/aa7aaea595e14111a5022167984d663f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:51.199927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7aaea595e14111a5022167984d663f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:51.201829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:51.253069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7aaea595e14111a5022167984d663f', 'request_id': 'req-90b59eeb-40cc-4d68-b597-413584297d35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.259223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7aaea595e14111a5022167984d663f', 'request_id': 'req-90b59eeb-40cc-4d68-b597-413584297d35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.264793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7aaea595e14111a5022167984d663f', 'request_id': 'req-90b59eeb-40cc-4d68-b597-413584297d35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.278137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] The token cache is being invalidate because project aa7aaea595e14111a5022167984d663f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:51.278471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.279097 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.283838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1234/2451] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:51 2022] DELETE /identity/v3/projects/aa7aaea595e14111a5022167984d663f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:51.285022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435fe8a-b2eb-4e80-bef5-fb636cf9f472 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:51.294698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435fe8a-b2eb-4e80-bef5-fb636cf9f472 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:51.352926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:51.353556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:51.353833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:51.354130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] PATH_INFO: `/v3/users/5e2eb7a31c0e472097cfd528e647db01` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:51.355283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2eb7a31c0e472097cfd528e647db01)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:51.357199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:51.404820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2eb7a31c0e472097cfd528e647db01'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.412159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2eb7a31c0e472097cfd528e647db01'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.412859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2eb7a31c0e472097cfd528e647db01'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.420772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2eb7a31c0e472097cfd528e647db01'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.438250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-62926285-e314-4306-9109-e83735f46b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2eb7a31c0e472097cfd528e647db01'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.444940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1218/2452] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:51 2022] DELETE /identity/v3/users/5e2eb7a31c0e472097cfd528e647db01 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:51.747130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:51.748723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:51.768149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59eeb-40cc-4d68-b597-413584297d35 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:51.845621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:51.846320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:51.846607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:51.846877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] PATH_INFO: `/v3/projects/f8a11abfc2e0450db7491b481b44b506` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:51.848053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a11abfc2e0450db7491b481b44b506)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:51.850094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:51.893953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:51.910545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a11abfc2e0450db7491b481b44b506', 'request_id': 'req-0c7a0b15-71e3-4466-8705-80b03603c156'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.917690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a11abfc2e0450db7491b481b44b506', 'request_id': 'req-0c7a0b15-71e3-4466-8705-80b03603c156'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.924753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a11abfc2e0450db7491b481b44b506', 'request_id': 'req-0c7a0b15-71e3-4466-8705-80b03603c156'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.939137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] The token cache is being invalidate because project f8a11abfc2e0450db7491b481b44b506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:51.939570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.940458 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0c7a0b15-71e3-4466-8705-80b03603c156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:51.942046 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1235/2453] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:51 2022] DELETE /identity/v3/projects/f8a11abfc2e0450db7491b481b44b506 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:51.947293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7d51-225d-4012-8eeb-3a92ddb2b28c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:51.948220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7d51-225d-4012-8eeb-3a92ddb2b28c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:51.948220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7d51-225d-4012-8eeb-3a92ddb2b28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:51.998982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-276b7d51-225d-4012-8eeb-3a92ddb2b28c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:52.000178 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-276b7d51-225d-4012-8eeb-3a92ddb2b28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:52.032271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:52.064569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1219/2454] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:23:52.072186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc923-97e2-44a2-b553-af4600d74c1b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.072503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc923-97e2-44a2-b553-af4600d74c1b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.072729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc923-97e2-44a2-b553-af4600d74c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.096131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-04fcc923-97e2-44a2-b553-af4600d74c1b None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:52.097337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-04fcc923-97e2-44a2-b553-af4600d74c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:52.105161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1236/2455] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:52.109387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b7d51-225d-4012-8eeb-3a92ddb2b28c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.120481 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b7d51-225d-4012-8eeb-3a92ddb2b28c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.125072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.125681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.125967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.126241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.126921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:23:52.127244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.128848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.140970 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1220/2456] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:23:52.145702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcc923-97e2-44a2-b553-af4600d74c1b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.155322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcc923-97e2-44a2-b553-af4600d74c1b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.160596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c5def-a556-4a91-a57b-b053d2521e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.161194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c5def-a556-4a91-a57b-b053d2521e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.161477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c5def-a556-4a91-a57b-b053d2521e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.161752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c5def-a556-4a91-a57b-b053d2521e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.162426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c5def-a556-4a91-a57b-b053d2521e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.164317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c5def-a556-4a91-a57b-b053d2521e98 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.191652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1237/2457] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:52 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:52.195956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.205800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c7d0-bca2-4233-89b6-e970f866f525 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.261417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dde44-52c5-412e-8870-22f055b1b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.261932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dde44-52c5-412e-8870-22f055b1b5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.262214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dde44-52c5-412e-8870-22f055b1b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.262515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dde44-52c5-412e-8870-22f055b1b5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.263145 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dde44-52c5-412e-8870-22f055b1b5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.265040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dde44-52c5-412e-8870-22f055b1b5d3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.287007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1221/2458] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:52 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:52.291626 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c5def-a556-4a91-a57b-b053d2521e98 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.302433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c5def-a556-4a91-a57b-b053d2521e98 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.307002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c31a9b-7a6e-467c-8fd2-18d852df7935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.307595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c31a9b-7a6e-467c-8fd2-18d852df7935 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.307875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c31a9b-7a6e-467c-8fd2-18d852df7935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.308149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c31a9b-7a6e-467c-8fd2-18d852df7935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.308811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c31a9b-7a6e-467c-8fd2-18d852df7935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.310420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c31a9b-7a6e-467c-8fd2-18d852df7935 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.320716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1238/2459] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:52.324627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dde44-52c5-412e-8870-22f055b1b5d3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.335414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dde44-52c5-412e-8870-22f055b1b5d3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.339933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f4e50-c146-41f8-84cc-67c47f3263a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.340526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4e50-c146-41f8-84cc-67c47f3263a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.340806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4e50-c146-41f8-84cc-67c47f3263a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.341076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4e50-c146-41f8-84cc-67c47f3263a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.341733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f4e50-c146-41f8-84cc-67c47f3263a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.343387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f4e50-c146-41f8-84cc-67c47f3263a0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.355757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1222/2460] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:52.359964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c31a9b-7a6e-467c-8fd2-18d852df7935 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.370081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c31a9b-7a6e-467c-8fd2-18d852df7935 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.374658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca1b9-f8c4-4577-a098-c5a148a7b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.375303 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca1b9-f8c4-4577-a098-c5a148a7b7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.375588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca1b9-f8c4-4577-a098-c5a148a7b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.375874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca1b9-f8c4-4577-a098-c5a148a7b7ed admin admin] PATH_INFO: `/v3/projects/59358f4586a6418a83700e8a2a014283/users/c33ebcf568e14c48bb0fb598ac3a62ba/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.391397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca1b9-f8c4-4577-a098-c5a148a7b7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=59358f4586a6418a83700e8a2a014283, user_id=c33ebcf568e14c48bb0fb598ac3a62ba, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.394792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca1b9-f8c4-4577-a098-c5a148a7b7ed admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.408426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1239/2461] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:52 2022] PUT /identity/v3/projects/59358f4586a6418a83700e8a2a014283/users/c33ebcf568e14c48bb0fb598ac3a62ba/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:52.478086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b814f87-1bf7-4958-b468-72dc8ffb615f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.478395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b814f87-1bf7-4958-b468-72dc8ffb615f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.478678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b814f87-1bf7-4958-b468-72dc8ffb615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.506731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9b814f87-1bf7-4958-b468-72dc8ffb615f None None] MFA Rules not processed for user `c33ebcf568e14c48bb0fb598ac3a62ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:52.507941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9b814f87-1bf7-4958-b468-72dc8ffb615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:52.575092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1223/2462] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:52.579769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca1b9-f8c4-4577-a098-c5a148a7b7ed admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.659938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca1b9-f8c4-4577-a098-c5a148a7b7ed admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.665003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f85a5e-ea74-44d9-b6e8-60788e896dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.666004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f85a5e-ea74-44d9-b6e8-60788e896dae admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.666316 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f85a5e-ea74-44d9-b6e8-60788e896dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.666601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f85a5e-ea74-44d9-b6e8-60788e896dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.667258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f85a5e-ea74-44d9-b6e8-60788e896dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.669183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f85a5e-ea74-44d9-b6e8-60788e896dae admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.698072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1240/2463] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:52 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:23:52.701840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b814f87-1bf7-4958-b468-72dc8ffb615f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.713929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b814f87-1bf7-4958-b468-72dc8ffb615f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.742617 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:52.772554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c675-0ba6-4941-b6ad-734fe5c783ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.773168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c675-0ba6-4941-b6ad-734fe5c783ac admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.773451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c675-0ba6-4941-b6ad-734fe5c783ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.773730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c675-0ba6-4941-b6ad-734fe5c783ac admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.774411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646c675-0ba6-4941-b6ad-734fe5c783ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.776325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646c675-0ba6-4941-b6ad-734fe5c783ac admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.797868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1224/2464] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:52 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:52.802124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f85a5e-ea74-44d9-b6e8-60788e896dae admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.812405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f85a5e-ea74-44d9-b6e8-60788e896dae admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.817695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b95044-21fd-4d08-bf65-82554de16716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.818327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95044-21fd-4d08-bf65-82554de16716 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.818615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95044-21fd-4d08-bf65-82554de16716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.818894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95044-21fd-4d08-bf65-82554de16716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.819616 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b95044-21fd-4d08-bf65-82554de16716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.821220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b95044-21fd-4d08-bf65-82554de16716 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.832913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1241/2465] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:52.837430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c675-0ba6-4941-b6ad-734fe5c783ac admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.848355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c675-0ba6-4941-b6ad-734fe5c783ac admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.853048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eb288-953a-472c-853e-1514232d03a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.853707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb288-953a-472c-853e-1514232d03a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.853993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb288-953a-472c-853e-1514232d03a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.854280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb288-953a-472c-853e-1514232d03a9 admin admin] PATH_INFO: `/v3/projects/9aacc2ab0e5e42278a9f92cff9e5542e/users/28384389a26a420fbd757ef1f094d94c/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.870787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eb288-953a-472c-853e-1514232d03a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aacc2ab0e5e42278a9f92cff9e5542e, user_id=28384389a26a420fbd757ef1f094d94c, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.873653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eb288-953a-472c-853e-1514232d03a9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.887294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1225/2466] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:52 2022] PUT /identity/v3/projects/9aacc2ab0e5e42278a9f92cff9e5542e/users/28384389a26a420fbd757ef1f094d94c/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:52.891273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b95044-21fd-4d08-bf65-82554de16716 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:52.902743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b95044-21fd-4d08-bf65-82554de16716 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:52.932179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:52.969277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34cf6f-08f8-4a18-8da0-b0e6d785060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:52.969277 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34cf6f-08f8-4a18-8da0-b0e6d785060d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:52.969504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34cf6f-08f8-4a18-8da0-b0e6d785060d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:52.969776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34cf6f-08f8-4a18-8da0-b0e6d785060d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:52.970998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34cf6f-08f8-4a18-8da0-b0e6d785060d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:52.972609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34cf6f-08f8-4a18-8da0-b0e6d785060d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:52.984518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1242/2467] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:23:52.989347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eb288-953a-472c-853e-1514232d03a9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:53.000401 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eb288-953a-472c-853e-1514232d03a9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:53.006714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:53.007389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:53.007671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:53.007950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] PATH_INFO: `/v3/projects/9aacc2ab0e5e42278a9f92cff9e5542e/users/28384389a26a420fbd757ef1f094d94c/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:53.009988 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aacc2ab0e5e42278a9f92cff9e5542e, user_id=28384389a26a420fbd757ef1f094d94c, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:53.012652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:53.026103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1226/2468] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:52 2022] PUT /identity/v3/projects/9aacc2ab0e5e42278a9f92cff9e5542e/users/28384389a26a420fbd757ef1f094d94c/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:53.037453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fe93-eca7-42d8-bb6f-8c5e4902f0ea None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:53.037741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fe93-eca7-42d8-bb6f-8c5e4902f0ea None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:53.038003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fe93-eca7-42d8-bb6f-8c5e4902f0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:53.068635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-75d0fe93-eca7-42d8-bb6f-8c5e4902f0ea None None] MFA Rules not processed for user `28384389a26a420fbd757ef1f094d94c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:53.069982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-75d0fe93-eca7-42d8-bb6f-8c5e4902f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:53.140846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1243/2469] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:53.153769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:53.155489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:53.213690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c84d9-6394-43ee-a8e1-ddf9b5e3f460 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:53.217443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1748b91-7222-4472-9eb8-7dd6155bec1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:53.218048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748b91-7222-4472-9eb8-7dd6155bec1c service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:53.218365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748b91-7222-4472-9eb8-7dd6155bec1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:53.218639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748b91-7222-4472-9eb8-7dd6155bec1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:53.228561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1748b91-7222-4472-9eb8-7dd6155bec1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:53.229981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1748b91-7222-4472-9eb8-7dd6155bec1c service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:53.239881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1227/2470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:53.287820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0fe93-eca7-42d8-bb6f-8c5e4902f0ea None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:53.289754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-75d0fe93-eca7-42d8-bb6f-8c5e4902f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:53.302740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0fe93-eca7-42d8-bb6f-8c5e4902f0ea None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:53.306431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf01f19-5ef7-4e88-b11b-130a57f1dd9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:53.307035 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01f19-5ef7-4e88-b11b-130a57f1dd9a service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:53.307317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01f19-5ef7-4e88-b11b-130a57f1dd9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:53.307602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01f19-5ef7-4e88-b11b-130a57f1dd9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:53.364704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf01f19-5ef7-4e88-b11b-130a57f1dd9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:53.366069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf01f19-5ef7-4e88-b11b-130a57f1dd9a service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:53.375053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1244/2471] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:56.771717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1748b91-7222-4472-9eb8-7dd6155bec1c service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:56.841960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1748b91-7222-4472-9eb8-7dd6155bec1c service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:56.848087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:56.848894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:56.849238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:56.849598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] PATH_INFO: `/v3/users/c33ebcf568e14c48bb0fb598ac3a62ba` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:56.850895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33ebcf568e14c48bb0fb598ac3a62ba)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:56.853062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:56.896765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:56.918961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33ebcf568e14c48bb0fb598ac3a62ba'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:56.926551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33ebcf568e14c48bb0fb598ac3a62ba'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:56.927234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33ebcf568e14c48bb0fb598ac3a62ba'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:56.935556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33ebcf568e14c48bb0fb598ac3a62ba'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:56.948831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33ebcf568e14c48bb0fb598ac3a62ba'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:56.955698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1228/2472] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:56 2022] DELETE /identity/v3/users/c33ebcf568e14c48bb0fb598ac3a62ba => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:23:56.960375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20b09-837f-4323-82c0-b52ac3b6f3c8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:56.960870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20b09-837f-4323-82c0-b52ac3b6f3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:56.960973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed20b09-837f-4323-82c0-b52ac3b6f3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:56.980890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1ed20b09-837f-4323-82c0-b52ac3b6f3c8 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:56.982104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1ed20b09-837f-4323-82c0-b52ac3b6f3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:57.026394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:57.043184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1245/2473] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:57.054098 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:57.055587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:57.121636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1553c-e375-41f8-8dcf-2ed7faf40a35 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:57.125287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7408970-500b-4424-bc7a-9250045c0949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:57.126835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7408970-500b-4424-bc7a-9250045c0949 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:57.127159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7408970-500b-4424-bc7a-9250045c0949 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:57.127384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7408970-500b-4424-bc7a-9250045c0949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:57.137784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7408970-500b-4424-bc7a-9250045c0949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:57.139262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7408970-500b-4424-bc7a-9250045c0949 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:57.149891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1229/2474] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:57.483444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20b09-837f-4323-82c0-b52ac3b6f3c8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:57.486962 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1ed20b09-837f-4323-82c0-b52ac3b6f3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:57.507519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed20b09-837f-4323-82c0-b52ac3b6f3c8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:57.516548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:57.517206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:57.517635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:57.518079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] PATH_INFO: `/v3/projects/59358f4586a6418a83700e8a2a014283` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:57.519256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=59358f4586a6418a83700e8a2a014283)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:57.533662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:57.579542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59358f4586a6418a83700e8a2a014283', 'request_id': 'req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.586381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59358f4586a6418a83700e8a2a014283', 'request_id': 'req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.592540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59358f4586a6418a83700e8a2a014283', 'request_id': 'req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.606672 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] The token cache is being invalidate because project 59358f4586a6418a83700e8a2a014283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:57.607092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.607719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.609269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1246/2475] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:57 2022] DELETE /identity/v3/projects/59358f4586a6418a83700e8a2a014283 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:57.613351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7408970-500b-4424-bc7a-9250045c0949 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:57.623030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7408970-500b-4424-bc7a-9250045c0949 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:57.681589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:57.682216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:57.682554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:57.682815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] PATH_INFO: `/v3/users/28384389a26a420fbd757ef1f094d94c` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:57.683939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28384389a26a420fbd757ef1f094d94c)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:57.685851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:57.732324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28384389a26a420fbd757ef1f094d94c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.734441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:57.741413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28384389a26a420fbd757ef1f094d94c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.742218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28384389a26a420fbd757ef1f094d94c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.749964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28384389a26a420fbd757ef1f094d94c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.762109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a9cc1137-6b59-4b3d-85f3-759828d86757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28384389a26a420fbd757ef1f094d94c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:57.768606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1230/2476] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:57 2022] DELETE /identity/v3/users/28384389a26a420fbd757ef1f094d94c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:58.053148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:58.055380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:58.069388 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef606b-1a3c-4f6f-9b04-4fa5c464f24d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:58.129252 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:58.129882 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.130166 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.130477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] PATH_INFO: `/v3/projects/9aacc2ab0e5e42278a9f92cff9e5542e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.131596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aacc2ab0e5e42278a9f92cff9e5542e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:58.133483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:58.181363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aacc2ab0e5e42278a9f92cff9e5542e', 'request_id': 'req-d6631b05-26fc-4c92-8636-f7d063ee955e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:58.187947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aacc2ab0e5e42278a9f92cff9e5542e', 'request_id': 'req-d6631b05-26fc-4c92-8636-f7d063ee955e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:58.194699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aacc2ab0e5e42278a9f92cff9e5542e', 'request_id': 'req-d6631b05-26fc-4c92-8636-f7d063ee955e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:58.208513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] The token cache is being invalidate because project 9aacc2ab0e5e42278a9f92cff9e5542e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:58.208810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:58.209778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d6631b05-26fc-4c92-8636-f7d063ee955e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:58.211317 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1247/2477] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:58 2022] DELETE /identity/v3/projects/9aacc2ab0e5e42278a9f92cff9e5542e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:58.221849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa674c5-7fe2-4747-aa8d-c418e30ba292 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.222372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa674c5-7fe2-4747-aa8d-c418e30ba292 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.222710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa674c5-7fe2-4747-aa8d-c418e30ba292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.244833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5aa674c5-7fe2-4747-aa8d-c418e30ba292 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:58.246056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5aa674c5-7fe2-4747-aa8d-c418e30ba292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:58.314724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1231/2478] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:58.322190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98894c8a-1972-426b-a04d-7a44a2464cef None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.322505 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98894c8a-1972-426b-a04d-7a44a2464cef None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.322783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98894c8a-1972-426b-a04d-7a44a2464cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.331240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:58.347182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-98894c8a-1972-426b-a04d-7a44a2464cef None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:58.348382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-98894c8a-1972-426b-a04d-7a44a2464cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:58.356392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1248/2479] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:58.361018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa674c5-7fe2-4747-aa8d-c418e30ba292 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:58.370696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa674c5-7fe2-4747-aa8d-c418e30ba292 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:58.375362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:58.376006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.376357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.376638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.377288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:23:58.377596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:58.379281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:58.392163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1232/2480] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:23:58.396575 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98894c8a-1972-426b-a04d-7a44a2464cef None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:58.406055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98894c8a-1972-426b-a04d-7a44a2464cef None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:58.411644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20657d-d95c-4fc0-a133-3900a741a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:58.412258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20657d-d95c-4fc0-a133-3900a741a7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.412542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20657d-d95c-4fc0-a133-3900a741a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.412811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20657d-d95c-4fc0-a133-3900a741a7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.413618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20657d-d95c-4fc0-a133-3900a741a7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:58.415535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20657d-d95c-4fc0-a133-3900a741a7f2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:58.449327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1249/2481] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:58 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:58.453436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:58.464850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97491c03-01fd-480f-ab02-6eaaaa1f0c01 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:58.524790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce7c8d-9d3a-426d-8d8f-3dadda6c355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:58.525422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7c8d-9d3a-426d-8d8f-3dadda6c355e admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.525700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7c8d-9d3a-426d-8d8f-3dadda6c355e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.525975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7c8d-9d3a-426d-8d8f-3dadda6c355e admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.526665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7c8d-9d3a-426d-8d8f-3dadda6c355e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:58.528599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7c8d-9d3a-426d-8d8f-3dadda6c355e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:58.559609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1233/2482] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:58 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:58.564597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20657d-d95c-4fc0-a133-3900a741a7f2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:58.575783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20657d-d95c-4fc0-a133-3900a741a7f2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:58.581176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0765-671e-41c0-a605-66dd3941ea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:58.581809 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0765-671e-41c0-a605-66dd3941ea6a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.582092 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0765-671e-41c0-a605-66dd3941ea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.582406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0765-671e-41c0-a605-66dd3941ea6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.583054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0765-671e-41c0-a605-66dd3941ea6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:58.584972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0765-671e-41c0-a605-66dd3941ea6a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:58.597211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1250/2483] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:58.601448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce7c8d-9d3a-426d-8d8f-3dadda6c355e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:58.613206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce7c8d-9d3a-426d-8d8f-3dadda6c355e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:58.619543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a070813-e551-4b2a-99fd-0c1397d79ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:58.620190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070813-e551-4b2a-99fd-0c1397d79ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.620477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070813-e551-4b2a-99fd-0c1397d79ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.620756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070813-e551-4b2a-99fd-0c1397d79ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.621442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a070813-e551-4b2a-99fd-0c1397d79ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:58.623380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a070813-e551-4b2a-99fd-0c1397d79ca8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:58.637619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1234/2484] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:58.641772 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0765-671e-41c0-a605-66dd3941ea6a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:58.652289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0765-671e-41c0-a605-66dd3941ea6a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:58.657630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:58.658624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.658916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.659205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] PATH_INFO: `/v3/projects/34ed36f6fed0453c9f341c358c347dcb/users/52600a45490f46cf944278b2d0684080/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.675472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ed36f6fed0453c9f341c358c347dcb, user_id=52600a45490f46cf944278b2d0684080, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:58.678112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:58.691461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1251/2485] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:58 2022] PUT /identity/v3/projects/34ed36f6fed0453c9f341c358c347dcb/users/52600a45490f46cf944278b2d0684080/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:58.702763 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604d405-2012-4153-ad11-0b0e468f1fa3 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.703053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604d405-2012-4153-ad11-0b0e468f1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.703334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604d405-2012-4153-ad11-0b0e468f1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.732051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a604d405-2012-4153-ad11-0b0e468f1fa3 None None] MFA Rules not processed for user `52600a45490f46cf944278b2d0684080`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:58.733500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a604d405-2012-4153-ad11-0b0e468f1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:58.754113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:58.800635 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1235/2486] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:23:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:23:58.811546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:58.813237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:58.874063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c46eb-04f3-49ce-a6da-6a254c17e209 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:58.878373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:58.878979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:58.879257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:58.879529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:58.887858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:58.889206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:58.898621 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1252/2487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:24:00.262612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcf0e-45f0-4e73-b192-59a309e67af8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:24:00.263149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcf0e-45f0-4e73-b192-59a309e67af8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:24:00.263149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcf0e-45f0-4e73-b192-59a309e67af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:24:00.282877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-429dcf0e-45f0-4e73-b192-59a309e67af8 None None] MFA Rules not processed for user `52600a45490f46cf944278b2d0684080`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:24:00.284106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-429dcf0e-45f0-4e73-b192-59a309e67af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:24:00.290941 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1236/2488] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:24:08.894722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:10.276708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=20 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:23.405446 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:24:23.406881 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:24:23.482935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ea74-5b78-455a-9ac8-de65b4690ae6 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:24:23.489184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf10d7-75bc-430e-814a-5651a9d6ac4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:24:23.489824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf10d7-75bc-430e-814a-5651a9d6ac4b service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:24:23.490100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf10d7-75bc-430e-814a-5651a9d6ac4b service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:24:23.490406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf10d7-75bc-430e-814a-5651a9d6ac4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:24:23.492115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cfcf10d7-75bc-430e-814a-5651a9d6ac4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:24:23.549362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf10d7-75bc-430e-814a-5651a9d6ac4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:24:23.551026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf10d7-75bc-430e-814a-5651a9d6ac4b service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:24:23.560098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1253/2489] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:24:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:24:33.555868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=56 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:57.561277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcf0e-45f0-4e73-b192-59a309e67af8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:24:57.562803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-429dcf0e-45f0-4e73-b192-59a309e67af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:24:57.681696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcf0e-45f0-4e73-b192-59a309e67af8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:24:57.687137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:24:57.687905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:24:57.688197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:24:57.688475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:24:57.690327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:24:57.702909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:24:57.704647 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:24:57.716495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1237/2490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:24:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:25:00.748792 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db1ef4-ff34-4f71-ab6d-4ff0ce55a718 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:00.749678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db1ef4-ff34-4f71-ab6d-4ff0ce55a718 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:00.749949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db1ef4-ff34-4f71-ab6d-4ff0ce55a718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:00.771269 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-90db1ef4-ff34-4f71-ab6d-4ff0ce55a718 None None] MFA Rules not processed for user `d713712c30574895b82beedb9c4f251d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:25:00.773120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90db1ef4-ff34-4f71-ab6d-4ff0ce55a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:00.830923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1254/2491] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:25:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:25:07.712040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=41 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:10.823806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=25 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:43.563203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:43.564964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:43.667592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34d71f-3735-487a-9c6e-eff29216ce78 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:43.672408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:43.673355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:43.673641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:43.673918 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:43.675861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:43.750170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:43.751943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:43.762313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1238/2492] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:25:47.534833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db1ef4-ff34-4f71-ab6d-4ff0ce55a718 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:47.536254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90db1ef4-ff34-4f71-ab6d-4ff0ce55a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:47.551361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db1ef4-ff34-4f71-ab6d-4ff0ce55a718 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:47.556737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:47.557344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:47.557623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:47.558021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:47.560214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:47.577357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:47.578943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:47.596198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1255/2493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:25:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:25:48.596474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:48.605895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d41c-023e-40dd-92d4-0d9b089aa4dc service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:48.610324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:48.610965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:48.611251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:48.611531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:48.614219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:48.635324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:48.636920 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:48.650161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1239/2494] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:25:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:25:49.261959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:49.275826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a69eb-b319-446c-8619-5a7e3bb753e2 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:49.280174 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:49.280789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:49.281072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:49.281348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:49.288126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:49.306628 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:49.307479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:49.321363 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1256/2495] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:25:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:25:51.324392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:51.325992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:51.339952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3592d-d60d-41cf-99f2-fc86c8a0a148 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:51.344811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:51.345519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:51.345805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:51.346083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] PATH_INFO: `/v3/users/bd69ef83d23d49fcbedcd308b1edf957` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:51.347250 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd69ef83d23d49fcbedcd308b1edf957)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:51.349175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:51.399115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd69ef83d23d49fcbedcd308b1edf957'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.406418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd69ef83d23d49fcbedcd308b1edf957'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.407174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd69ef83d23d49fcbedcd308b1edf957'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.415027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd69ef83d23d49fcbedcd308b1edf957'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.421986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:51.428112 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd69ef83d23d49fcbedcd308b1edf957'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.436853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1240/2496] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:25:51 2022] DELETE /identity/v3/users/bd69ef83d23d49fcbedcd308b1edf957 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:25:51.615516 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:51.630356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5720cf-b5ca-440d-8402-5a0898d6a7df service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:51.687880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:51.688785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:51.689280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:51.689783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] PATH_INFO: `/v3/projects/f4336b9623424da8982f8a56ddee5a7a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:51.691003 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4336b9623424da8982f8a56ddee5a7a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:51.693208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:51.743639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4336b9623424da8982f8a56ddee5a7a', 'request_id': 'req-637edd14-ee1e-4c96-b640-a14652ada94b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.749947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4336b9623424da8982f8a56ddee5a7a', 'request_id': 'req-637edd14-ee1e-4c96-b640-a14652ada94b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.760600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4336b9623424da8982f8a56ddee5a7a', 'request_id': 'req-637edd14-ee1e-4c96-b640-a14652ada94b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.780314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] The token cache is being invalidate because project f4336b9623424da8982f8a56ddee5a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:25:51.781086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.781993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.784510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1257/2497] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:25:51 2022] DELETE /identity/v3/projects/f4336b9623424da8982f8a56ddee5a7a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:25:51.788545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:51.790953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:51.807368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d5b06-f1b8-40c4-a750-fd290ad04132 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:51.878369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:51.879010 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:51.879392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:51.879644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] PATH_INFO: `/v3/users/2f57cbb7d9bc45d6b73a76c12f5174de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:51.880864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f57cbb7d9bc45d6b73a76c12f5174de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:51.882799 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:51.934313 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f57cbb7d9bc45d6b73a76c12f5174de'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.943437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f57cbb7d9bc45d6b73a76c12f5174de'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.944408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f57cbb7d9bc45d6b73a76c12f5174de'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.955208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f57cbb7d9bc45d6b73a76c12f5174de'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.969243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f57cbb7d9bc45d6b73a76c12f5174de'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:51.975619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1241/2498] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:25:51 2022] DELETE /identity/v3/users/2f57cbb7d9bc45d6b73a76c12f5174de => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:25:52.190794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:52.192653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:52.206101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637edd14-ee1e-4c96-b640-a14652ada94b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:52.266700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:52.267335 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:52.267613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:52.267886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] PATH_INFO: `/v3/projects/d95dbb58bc1243179de233d187ba87d0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:52.269111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95dbb58bc1243179de233d187ba87d0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:52.271271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:52.278184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:52.328098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95dbb58bc1243179de233d187ba87d0', 'request_id': 'req-005ca0e5-5c43-4979-b365-ad2a06861f33'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:52.335589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95dbb58bc1243179de233d187ba87d0', 'request_id': 'req-005ca0e5-5c43-4979-b365-ad2a06861f33'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:52.341928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95dbb58bc1243179de233d187ba87d0', 'request_id': 'req-005ca0e5-5c43-4979-b365-ad2a06861f33'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:52.355260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] The token cache is being invalidate because project d95dbb58bc1243179de233d187ba87d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:25:52.355551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:52.356221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:25:52.357700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1258/2499] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:25:52 2022] DELETE /identity/v3/projects/d95dbb58bc1243179de233d187ba87d0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:26:01.971759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=57,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:02.351552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:12.988889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:26:12.990479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:26:13.077633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a34b5-9f91-4735-8f4d-03ac8d6ed87e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:26:13.144400 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:26:13.145013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:26:13.145302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:26:13.145575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:26:13.147343 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:26:13.229333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:26:13.231600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:26:13.254038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1242/2500] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:26:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:26:15.412109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:26:15.413597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:26:15.429953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ca0e5-5c43-4979-b365-ad2a06861f33 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:26:15.436227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:26:15.436842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:26:15.437122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:26:15.437396 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:26:15.445095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:26:15.549292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:26:15.550952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:26:15.571605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1259/2501] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:26:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:26:23.250351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:25.568533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=41 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:29.069797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:27:29.071293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:27:29.085736 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965dd91-d020-4c9d-849f-15d5fdf7fe71 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:27:29.091958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:27:29.093241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:27:29.093517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:27:29.093791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:27:29.095613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:27:29.168074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:27:29.169741 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:27:29.180455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1243/2502] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:27:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:27:39.175730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=28 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:29.958116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.959633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:30.043410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa363996-e211-48ad-930c-76342c5e5ba8 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:30.049073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:30.049959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:30.050383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:30.050665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:30.052491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:30.064729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:30.066483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:30.077843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1260/2503] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:30.977744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:30.979435 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:30.995905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671518e-07bf-4987-a05c-9b97b4a63e91 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:31.003671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:31.004716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:31.005049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:31.005551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:31.015408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:31.029297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:31.030949 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:31.046702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1244/2504] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:31.200592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:31.202415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:31.262627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b31d1-c9d8-47b3-a546-ab4ff34d45eb service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:31.266212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:31.266850 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:31.267167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:31.267437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:31.269195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:31.343573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:31.345129 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:31.358539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1261/2505] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:31.970364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:31.971921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:31.983639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269656-6e90-46d6-8932-f6219a3e90f7 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:31.988856 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:31.989462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:31.989925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:31.990416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:31.992252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:32.005885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:32.007359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:32.019578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1245/2506] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:36.283619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:36.301563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71e311-1326-4263-b4e5-2029b0fe85ea service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:36.316162 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:36.317417 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:36.317914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:36.318849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:36.320713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:36.335260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:36.337181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:36.353780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1262/2507] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:36.395670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:36.397654 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:36.416669 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d9c9-185b-4e28-807c-25aaaa4c62cf service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:36.423916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:36.425160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:36.425399 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:36.425679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] PATH_INFO: `/v3/users/eaf3d36d40d442019e09a3e4c32b8330` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:36.427303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf3d36d40d442019e09a3e4c32b8330)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:36.429657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:36.514951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf3d36d40d442019e09a3e4c32b8330'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:36.526716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf3d36d40d442019e09a3e4c32b8330'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:36.528085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf3d36d40d442019e09a3e4c32b8330'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:36.539862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf3d36d40d442019e09a3e4c32b8330'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:36.577981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-292ad854-bab1-4de8-a5d4-14f7056af8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf3d36d40d442019e09a3e4c32b8330'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:36.589127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1246/2508] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:36 2022] DELETE /identity/v3/users/eaf3d36d40d442019e09a3e4c32b8330 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:37.267904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:37.270699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5ad2-977f-4996-8bd2-01748da25d02 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.271607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5ad2-977f-4996-8bd2-01748da25d02 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.271950 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5ad2-977f-4996-8bd2-01748da25d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.280036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b41e0-ad28-4a59-8032-ed6072d6dc94 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:37.295523 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1f7a5ad2-977f-4996-8bd2-01748da25d02 None None] MFA Rules not processed for user `ccd2c619e9fc436ea01a1200bc46b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:37.298169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1f7a5ad2-977f-4996-8bd2-01748da25d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:37.325019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:37.371830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:37.372571 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.372778 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.373105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] PATH_INFO: `/v3/projects/b2e0d80b70984b39a3a4c07d0018f67b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.375142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e0d80b70984b39a3a4c07d0018f67b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:37.378195 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:37.378494 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1247/2509] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:37.438167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e0d80b70984b39a3a4c07d0018f67b', 'request_id': 'req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.451030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e0d80b70984b39a3a4c07d0018f67b', 'request_id': 'req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.457766 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e0d80b70984b39a3a4c07d0018f67b', 'request_id': 'req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.481180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] The token cache is being invalidate because project b2e0d80b70984b39a3a4c07d0018f67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:37.481822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.482932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.484661 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1263/2510] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:37 2022] DELETE /identity/v3/projects/b2e0d80b70984b39a3a4c07d0018f67b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:37.490492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c4e71-f0ed-4047-b5ff-f1c1a4582bfe None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.491465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c4e71-f0ed-4047-b5ff-f1c1a4582bfe None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.491751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c4e71-f0ed-4047-b5ff-f1c1a4582bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.512819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:37.514043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8c3c4e71-f0ed-4047-b5ff-f1c1a4582bfe None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:37.515030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:37.515631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8c3c4e71-f0ed-4047-b5ff-f1c1a4582bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:37.568931 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:37.591448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1248/2511] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:37.600678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018e021-4a3f-43a7-bc50-567250012163 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.601052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018e021-4a3f-43a7-bc50-567250012163 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.601567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018e021-4a3f-43a7-bc50-567250012163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.620578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f7d1c-e564-4cdb-8a8e-1e72454ccd11 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:37.627200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:37.628618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.629076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.629420 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] PATH_INFO: `/v3/users/7559a0b8d46b4524b40f68b992f6cfe9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.632638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7559a0b8d46b4524b40f68b992f6cfe9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:37.635825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:37.636052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0018e021-4a3f-43a7-bc50-567250012163 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:37.637582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0018e021-4a3f-43a7-bc50-567250012163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:37.651033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1249/2512] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:37.655831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018e021-4a3f-43a7-bc50-567250012163 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:37.675576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018e021-4a3f-43a7-bc50-567250012163 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:37.685693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:37.686716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.687184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.687630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.688722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:37.689291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:37.692174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:37.717198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1250/2513] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:37.718603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:37.726167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7559a0b8d46b4524b40f68b992f6cfe9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.734414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0ac9d-dada-4351-be81-4418d3cae8cb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:37.740263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7559a0b8d46b4524b40f68b992f6cfe9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.741338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7559a0b8d46b4524b40f68b992f6cfe9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.743171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:37.744139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.744730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.745210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.746386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:37.747763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:37.749674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:37.763024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7559a0b8d46b4524b40f68b992f6cfe9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.764128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7559a0b8d46b4524b40f68b992f6cfe9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:37.806836 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1264/2514] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:37 2022] DELETE /identity/v3/users/7559a0b8d46b4524b40f68b992f6cfe9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:37.808222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:37.809920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:37.824439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1251/2515] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:37 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:37.828737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:37.832210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:37.884692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378d4c3-ea42-419a-906e-6e3d12686d4c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:37.927913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4f74c-4158-4a7c-a3e0-0fb5098d9b96 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:37.937605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fe4fb-c150-4190-9db8-1a4ac6527a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:37.938366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fe4fb-c150-4190-9db8-1a4ac6527a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.938840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fe4fb-c150-4190-9db8-1a4ac6527a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.940027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fe4fb-c150-4190-9db8-1a4ac6527a22 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.941230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fe4fb-c150-4190-9db8-1a4ac6527a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:37.945567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fe4fb-c150-4190-9db8-1a4ac6527a22 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:37.955934 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:37.957038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:37.957537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:37.958581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:37.961839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:37.976498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:37.978232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1252/2516] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:37 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:37.982096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:37.982704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fe4fb-c150-4190-9db8-1a4ac6527a22 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:37.992980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fe4fb-c150-4190-9db8-1a4ac6527a22 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:37.998231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1265/2517] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:38.003317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.003317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.003317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.004828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.004828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.006631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.021925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1253/2518] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:38.024159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.036264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.039309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:38.050960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db81a0f-920a-4f16-ac5b-053960dff8ee service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.060722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59398dd-92b1-4bbd-866c-76207c3c23d0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.064869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1e45-3d12-4d8f-9f13-263927ce37d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.066028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1e45-3d12-4d8f-9f13-263927ce37d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.066586 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1e45-3d12-4d8f-9f13-263927ce37d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.067134 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1e45-3d12-4d8f-9f13-263927ce37d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.068339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d1e45-3d12-4d8f-9f13-263927ce37d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.071791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d1e45-3d12-4d8f-9f13-263927ce37d6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.073351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.074592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.074889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.075171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] PATH_INFO: `/v3/projects/631e2e8467654c0ea799bf50fed7afad` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.076908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=631e2e8467654c0ea799bf50fed7afad)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.082602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.095849 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1266/2519] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:38.100806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1e45-3d12-4d8f-9f13-263927ce37d6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.119617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1e45-3d12-4d8f-9f13-263927ce37d6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.134872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82bf8f-a04a-41b2-98f4-c01673cfe7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.135569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bf8f-a04a-41b2-98f4-c01673cfe7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.136308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bf8f-a04a-41b2-98f4-c01673cfe7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.136308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bf8f-a04a-41b2-98f4-c01673cfe7fe admin admin] PATH_INFO: `/v3/projects/3182cdea159e42c6999c0dde188fc2e6/users/4088eb66cebd45d4b5d59e8f467109f7/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.168353 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631e2e8467654c0ea799bf50fed7afad', 'request_id': 'req-97a90da2-2aff-49ff-b1fc-a81366841ac7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:38.168887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82bf8f-a04a-41b2-98f4-c01673cfe7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3182cdea159e42c6999c0dde188fc2e6, user_id=4088eb66cebd45d4b5d59e8f467109f7, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.171871 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82bf8f-a04a-41b2-98f4-c01673cfe7fe admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.178420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631e2e8467654c0ea799bf50fed7afad', 'request_id': 'req-97a90da2-2aff-49ff-b1fc-a81366841ac7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:38.190185 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631e2e8467654c0ea799bf50fed7afad', 'request_id': 'req-97a90da2-2aff-49ff-b1fc-a81366841ac7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:38.193837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1267/2520] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:38 2022] PUT /identity/v3/projects/3182cdea159e42c6999c0dde188fc2e6/users/4088eb66cebd45d4b5d59e8f467109f7/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:38.207935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308bea-ce85-43ef-b1a6-464e35ac55a3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.208535 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308bea-ce85-43ef-b1a6-464e35ac55a3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.208951 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308bea-ce85-43ef-b1a6-464e35ac55a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.216711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] The token cache is being invalidate because project 631e2e8467654c0ea799bf50fed7afad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:38.217005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:38.217857 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-97a90da2-2aff-49ff-b1fc-a81366841ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:38.220787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1254/2521] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:38 2022] DELETE /identity/v3/projects/631e2e8467654c0ea799bf50fed7afad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:38.226280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c98ab-62c7-4c12-be99-6d5dbe3f219f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.226623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c98ab-62c7-4c12-be99-6d5dbe3f219f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.226858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c98ab-62c7-4c12-be99-6d5dbe3f219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.235189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:38.247718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cb308bea-ce85-43ef-b1a6-464e35ac55a3 None None] MFA Rules not processed for user `4088eb66cebd45d4b5d59e8f467109f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:38.255098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb308bea-ce85-43ef-b1a6-464e35ac55a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:38.264483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-698c98ab-62c7-4c12-be99-6d5dbe3f219f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:38.265822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-698c98ab-62c7-4c12-be99-6d5dbe3f219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:38.318354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:38.350038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1268/2522] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:38.350941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb308bea-ce85-43ef-b1a6-464e35ac55a3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.352339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb308bea-ce85-43ef-b1a6-464e35ac55a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:38.383380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1255/2523] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:38.395055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2363f9-d9e8-4a1b-b777-00185e1df9d8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.396345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2363f9-d9e8-4a1b-b777-00185e1df9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.396345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2363f9-d9e8-4a1b-b777-00185e1df9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.422491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2b2363f9-d9e8-4a1b-b777-00185e1df9d8 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:38.424639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2b2363f9-d9e8-4a1b-b777-00185e1df9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:38.434605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1256/2524] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:38.437707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2363f9-d9e8-4a1b-b777-00185e1df9d8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.449493 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2363f9-d9e8-4a1b-b777-00185e1df9d8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.455801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.456613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.457170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.457447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.458113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:38.458502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.460141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.481448 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1257/2525] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:38.482203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.494061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60472-2e40-46bc-958b-24d7325266a3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.497775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb308bea-ce85-43ef-b1a6-464e35ac55a3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.500788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e01a98-2e90-4762-9db7-21327cac6f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.502333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e01a98-2e90-4762-9db7-21327cac6f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.502689 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e01a98-2e90-4762-9db7-21327cac6f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.503203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e01a98-2e90-4762-9db7-21327cac6f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.504059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e01a98-2e90-4762-9db7-21327cac6f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.507208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2785b5d-cfaf-4f2d-a2b2-6f3957f88e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.507476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e01a98-2e90-4762-9db7-21327cac6f89 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.508096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2785b5d-cfaf-4f2d-a2b2-6f3957f88e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.508523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2785b5d-cfaf-4f2d-a2b2-6f3957f88e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.508906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2785b5d-cfaf-4f2d-a2b2-6f3957f88e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.509684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2785b5d-cfaf-4f2d-a2b2-6f3957f88e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.511925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2785b5d-cfaf-4f2d-a2b2-6f3957f88e4f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.553292 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1258/2526] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:38.558117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e01a98-2e90-4762-9db7-21327cac6f89 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.566870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1269/2527] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:38.570240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2785b5d-cfaf-4f2d-a2b2-6f3957f88e4f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.639519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e01a98-2e90-4762-9db7-21327cac6f89 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.643812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2785b5d-cfaf-4f2d-a2b2-6f3957f88e4f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.644816 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad8d79-be59-4b51-a064-597e964f9cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.645429 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8d79-be59-4b51-a064-597e964f9cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.645716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8d79-be59-4b51-a064-597e964f9cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.645993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8d79-be59-4b51-a064-597e964f9cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.646743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad8d79-be59-4b51-a064-597e964f9cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.648714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ca4f7-fcc7-4088-ad99-dee8402910fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.648870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad8d79-be59-4b51-a064-597e964f9cf0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.649324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ca4f7-fcc7-4088-ad99-dee8402910fe admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.649606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ca4f7-fcc7-4088-ad99-dee8402910fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.649883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ca4f7-fcc7-4088-ad99-dee8402910fe admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.650580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ca4f7-fcc7-4088-ad99-dee8402910fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.652522 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ca4f7-fcc7-4088-ad99-dee8402910fe admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.673475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1259/2528] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:38.675648 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1270/2529] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:38.680003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad8d79-be59-4b51-a064-597e964f9cf0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.680146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ca4f7-fcc7-4088-ad99-dee8402910fe admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.690733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad8d79-be59-4b51-a064-597e964f9cf0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.691447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ca4f7-fcc7-4088-ad99-dee8402910fe admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.696036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30c2a5-ef53-4078-942e-d6f7d2ef27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.696244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165913de-0d35-4729-b847-29736a3d27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.696783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165913de-0d35-4729-b847-29736a3d27d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.696975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30c2a5-ef53-4078-942e-d6f7d2ef27fc admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.697157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165913de-0d35-4729-b847-29736a3d27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.697323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30c2a5-ef53-4078-942e-d6f7d2ef27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.697500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165913de-0d35-4729-b847-29736a3d27d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.697691 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30c2a5-ef53-4078-942e-d6f7d2ef27fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.697949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165913de-0d35-4729-b847-29736a3d27d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.698560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30c2a5-ef53-4078-942e-d6f7d2ef27fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.699591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165913de-0d35-4729-b847-29736a3d27d2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.700600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30c2a5-ef53-4078-942e-d6f7d2ef27fc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.711541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1271/2530] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:38.715927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1260/2531] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:38.716087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165913de-0d35-4729-b847-29736a3d27d2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.716909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30c2a5-ef53-4078-942e-d6f7d2ef27fc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.726619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30c2a5-ef53-4078-942e-d6f7d2ef27fc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.726833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165913de-0d35-4729-b847-29736a3d27d2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.731462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd3256-b618-40a3-b182-27fd4d6163d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.731728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb84ce3-9233-46b4-b1c0-91808565e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.732059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3256-b618-40a3-b182-27fd4d6163d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.732344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3256-b618-40a3-b182-27fd4d6163d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.732462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb84ce3-9233-46b4-b1c0-91808565e41f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.732613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3256-b618-40a3-b182-27fd4d6163d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.732725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb84ce3-9233-46b4-b1c0-91808565e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.733060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb84ce3-9233-46b4-b1c0-91808565e41f admin admin] PATH_INFO: `/v3/projects/8388d2d640334d35ae0ec4cbf699b552/users/a1033f0eaf48454a9d71a4474525c0bd/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.733243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd3256-b618-40a3-b182-27fd4d6163d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.734878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd3256-b618-40a3-b182-27fd4d6163d2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.745874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1261/2532] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:38.749971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb84ce3-9233-46b4-b1c0-91808565e41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8388d2d640334d35ae0ec4cbf699b552, user_id=a1033f0eaf48454a9d71a4474525c0bd, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.750135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd3256-b618-40a3-b182-27fd4d6163d2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.753229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb84ce3-9233-46b4-b1c0-91808565e41f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.760864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd3256-b618-40a3-b182-27fd4d6163d2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.768407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1272/2533] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:38 2022] PUT /identity/v3/projects/8388d2d640334d35ae0ec4cbf699b552/users/a1033f0eaf48454a9d71a4474525c0bd/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:38.772380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb84ce3-9233-46b4-b1c0-91808565e41f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.787385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:38.810636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:38.829073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570262c1-ca40-4ec2-acee-98e2a7fc5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.830530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570262c1-ca40-4ec2-acee-98e2a7fc5e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.830847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570262c1-ca40-4ec2-acee-98e2a7fc5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.831104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570262c1-ca40-4ec2-acee-98e2a7fc5e29 admin admin] PATH_INFO: `/v3/projects/3de52e6fb4e541fe82780b3c35097ebf/users/eb68ad17e41b40ac934c9563433a0f15/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.851685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570262c1-ca40-4ec2-acee-98e2a7fc5e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de52e6fb4e541fe82780b3c35097ebf, user_id=eb68ad17e41b40ac934c9563433a0f15, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.854428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570262c1-ca40-4ec2-acee-98e2a7fc5e29 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.854845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb84ce3-9233-46b4-b1c0-91808565e41f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.860170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba306c-7b78-4845-9fe8-6105f82fcd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.860899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba306c-7b78-4845-9fe8-6105f82fcd42 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.861223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba306c-7b78-4845-9fe8-6105f82fcd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.861611 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba306c-7b78-4845-9fe8-6105f82fcd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.862560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba306c-7b78-4845-9fe8-6105f82fcd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.864279 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba306c-7b78-4845-9fe8-6105f82fcd42 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.871718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1262/2534] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:38 2022] PUT /identity/v3/projects/3de52e6fb4e541fe82780b3c35097ebf/users/eb68ad17e41b40ac934c9563433a0f15/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:38.884900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3aad5-b12b-4481-b20a-f55df6001b83 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.885172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3aad5-b12b-4481-b20a-f55df6001b83 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.886157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3aad5-b12b-4481-b20a-f55df6001b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.886304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1273/2535] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:38.890726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba306c-7b78-4845-9fe8-6105f82fcd42 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:38.903382 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba306c-7b78-4845-9fe8-6105f82fcd42 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:38.930869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-53f3aad5-b12b-4481-b20a-f55df6001b83 None None] MFA Rules not processed for user `eb68ad17e41b40ac934c9563433a0f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:38.932168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-53f3aad5-b12b-4481-b20a-f55df6001b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:38.964093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef4bbb-a5f1-45dd-b5b9-a607b1a943c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:38.964781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4bbb-a5f1-45dd-b5b9-a607b1a943c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.965058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4bbb-a5f1-45dd-b5b9-a607b1a943c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.965328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4bbb-a5f1-45dd-b5b9-a607b1a943c7 admin admin] PATH_INFO: `/v3/projects/8388d2d640334d35ae0ec4cbf699b552/users/a1033f0eaf48454a9d71a4474525c0bd/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:38.967262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef4bbb-a5f1-45dd-b5b9-a607b1a943c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8388d2d640334d35ae0ec4cbf699b552, user_id=a1033f0eaf48454a9d71a4474525c0bd, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:38.969934 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef4bbb-a5f1-45dd-b5b9-a607b1a943c7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:38.980728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1274/2536] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:38 2022] PUT /identity/v3/projects/8388d2d640334d35ae0ec4cbf699b552/users/a1033f0eaf48454a9d71a4474525c0bd/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:38.991106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa83f-1378-48b3-98cb-094759c3ee86 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:38.991477 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa83f-1378-48b3-98cb-094759c3ee86 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:38.991752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa83f-1378-48b3-98cb-094759c3ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.000096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1263/2537] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:39.005255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3aad5-b12b-4481-b20a-f55df6001b83 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.015488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3aad5-b12b-4481-b20a-f55df6001b83 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.024197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-584aa83f-1378-48b3-98cb-094759c3ee86 None None] MFA Rules not processed for user `a1033f0eaf48454a9d71a4474525c0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:39.025333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-584aa83f-1378-48b3-98cb-094759c3ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:39.076601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1116-bac8-4ab1-87a1-e8a7bda22e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.077214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1116-bac8-4ab1-87a1-e8a7bda22e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.077490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1116-bac8-4ab1-87a1-e8a7bda22e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.077752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1116-bac8-4ab1-87a1-e8a7bda22e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.078472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1116-bac8-4ab1-87a1-e8a7bda22e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.081285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1116-bac8-4ab1-87a1-e8a7bda22e59 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.114237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1264/2538] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:39 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:39.116903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1275/2539] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:39.118528 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1116-bac8-4ab1-87a1-e8a7bda22e59 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.134032 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aa83f-1378-48b3-98cb-094759c3ee86 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.136209 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-584aa83f-1378-48b3-98cb-094759c3ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:39.157392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:39.193806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:39.197075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1116-bac8-4ab1-87a1-e8a7bda22e59 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.202108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9e9d-e692-4bdb-b35d-cda01e1615b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.202586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9e9d-e692-4bdb-b35d-cda01e1615b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.202919 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9e9d-e692-4bdb-b35d-cda01e1615b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.203244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9e9d-e692-4bdb-b35d-cda01e1615b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.203937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f9e9d-e692-4bdb-b35d-cda01e1615b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.207086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f9e9d-e692-4bdb-b35d-cda01e1615b6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.229264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aa83f-1378-48b3-98cb-094759c3ee86 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.230532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1265/2540] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:39 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:39.234582 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9e9d-e692-4bdb-b35d-cda01e1615b6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.244248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9e9d-e692-4bdb-b35d-cda01e1615b6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.249171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528242c8-05d4-498e-ac2c-8a4cf91f87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.249774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528242c8-05d4-498e-ac2c-8a4cf91f87f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.250052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528242c8-05d4-498e-ac2c-8a4cf91f87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.250352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528242c8-05d4-498e-ac2c-8a4cf91f87f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.250998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528242c8-05d4-498e-ac2c-8a4cf91f87f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.252671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528242c8-05d4-498e-ac2c-8a4cf91f87f3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.263957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1266/2541] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:39.269156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528242c8-05d4-498e-ac2c-8a4cf91f87f3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.280760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528242c8-05d4-498e-ac2c-8a4cf91f87f3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.286296 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867ea2-feb6-4e6a-ab76-5983bac83875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.287815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867ea2-feb6-4e6a-ab76-5983bac83875 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.287815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867ea2-feb6-4e6a-ab76-5983bac83875 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.287815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867ea2-feb6-4e6a-ab76-5983bac83875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.290914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98410a-06da-4636-b397-fbd15c68b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.291587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98410a-06da-4636-b397-fbd15c68b506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.291874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98410a-06da-4636-b397-fbd15c68b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.292148 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98410a-06da-4636-b397-fbd15c68b506 admin admin] PATH_INFO: `/v3/projects/158c5822e0674eec97fecb456966884b/users/71e410b0baa74547bb0df585518e7565/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.311638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98410a-06da-4636-b397-fbd15c68b506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158c5822e0674eec97fecb456966884b, user_id=71e410b0baa74547bb0df585518e7565, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.315074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98410a-06da-4636-b397-fbd15c68b506 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.332990 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1267/2542] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:39 2022] PUT /identity/v3/projects/158c5822e0674eec97fecb456966884b/users/71e410b0baa74547bb0df585518e7565/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:39.337712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98410a-06da-4636-b397-fbd15c68b506 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.369702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd867ea2-feb6-4e6a-ab76-5983bac83875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.371877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd867ea2-feb6-4e6a-ab76-5983bac83875 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.383756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1276/2543] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:39.435578 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98410a-06da-4636-b397-fbd15c68b506 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.442840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.443547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.443897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.444240 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.444956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.446587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.458769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1268/2544] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:39.463465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867ea2-feb6-4e6a-ab76-5983bac83875 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.478912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867ea2-feb6-4e6a-ab76-5983bac83875 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.486469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290a4d9-bafd-46ac-a9a1-09dbba77e140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.487562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290a4d9-bafd-46ac-a9a1-09dbba77e140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.488258 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290a4d9-bafd-46ac-a9a1-09dbba77e140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.488634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290a4d9-bafd-46ac-a9a1-09dbba77e140 admin admin] PATH_INFO: `/v3/projects/158c5822e0674eec97fecb456966884b/users/71e410b0baa74547bb0df585518e7565/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.491524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290a4d9-bafd-46ac-a9a1-09dbba77e140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158c5822e0674eec97fecb456966884b, user_id=71e410b0baa74547bb0df585518e7565, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.494975 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290a4d9-bafd-46ac-a9a1-09dbba77e140 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.519909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.520464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1277/2545] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:39 2022] PUT /identity/v3/projects/158c5822e0674eec97fecb456966884b/users/71e410b0baa74547bb0df585518e7565/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:39.522152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:39.524405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb7ece-3f2c-4b23-bfaf-24d5909efadc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.524702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb7ece-3f2c-4b23-bfaf-24d5909efadc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.524985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb7ece-3f2c-4b23-bfaf-24d5909efadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.574653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9fbb7ece-3f2c-4b23-bfaf-24d5909efadc None None] MFA Rules not processed for user `71e410b0baa74547bb0df585518e7565`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:39.576357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9fbb7ece-3f2c-4b23-bfaf-24d5909efadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:39.637132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2100e4e-6c0a-4b7b-9bfb-7a9dd21ef3b1 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.684344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:39.707920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1278/2546] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:39 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:39.722728 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb7ece-3f2c-4b23-bfaf-24d5909efadc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.727588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:39.772368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.773488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.774060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.774668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.777605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:39.799722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.803029 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.817595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb7ece-3f2c-4b23-bfaf-24d5909efadc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.821288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1269/2547] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:39.823740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46147a-10e6-415e-8f09-4a17edd647c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.824367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46147a-10e6-415e-8f09-4a17edd647c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.824652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46147a-10e6-415e-8f09-4a17edd647c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.824932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46147a-10e6-415e-8f09-4a17edd647c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.836459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46147a-10e6-415e-8f09-4a17edd647c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.838036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46147a-10e6-415e-8f09-4a17edd647c4 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.850294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1279/2548] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:39 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:39.991683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:40.058245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46147a-10e6-415e-8f09-4a17edd647c4 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:40.090016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd40df-7d35-45d6-ae1d-551f1b24ef75 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:40.096347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:40.097059 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.097285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.097560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] PATH_INFO: `/v3/users/4088eb66cebd45d4b5d59e8f467109f7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.098899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4088eb66cebd45d4b5d59e8f467109f7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:40.100865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:40.146182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46147a-10e6-415e-8f09-4a17edd647c4 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:40.155233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4088eb66cebd45d4b5d59e8f467109f7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.157255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:40.159019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.159457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.159735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] PATH_INFO: `/v3/users/eb68ad17e41b40ac934c9563433a0f15` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.161033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb68ad17e41b40ac934c9563433a0f15)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:40.163029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:40.166551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4088eb66cebd45d4b5d59e8f467109f7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.167375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4088eb66cebd45d4b5d59e8f467109f7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.176722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4088eb66cebd45d4b5d59e8f467109f7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.192251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-e62f0d10-9d72-498c-aa3f-73ba1d8b6797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4088eb66cebd45d4b5d59e8f467109f7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.198907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1270/2549] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:39 2022] DELETE /identity/v3/users/4088eb66cebd45d4b5d59e8f467109f7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:40.203375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e6ef5-45a6-4b4a-9c34-e7420c8dfadc None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.203745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e6ef5-45a6-4b4a-9c34-e7420c8dfadc None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.204091 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e6ef5-45a6-4b4a-9c34-e7420c8dfadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.226023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb68ad17e41b40ac934c9563433a0f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.229642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-3a3e6ef5-45a6-4b4a-9c34-e7420c8dfadc None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:40.231212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a3e6ef5-45a6-4b4a-9c34-e7420c8dfadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:40.242528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb68ad17e41b40ac934c9563433a0f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.243625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb68ad17e41b40ac934c9563433a0f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.253433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb68ad17e41b40ac934c9563433a0f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.254599 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f336072a-ef5d-47d5-b5c5-053458887207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb68ad17e41b40ac934c9563433a0f15'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.263114 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:40.281635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1280/2550] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:40 2022] DELETE /identity/v3/users/eb68ad17e41b40ac934c9563433a0f15 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:40.288605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd165fe-3fc4-437e-9bda-cfbed248bb28 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.289273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd165fe-3fc4-437e-9bda-cfbed248bb28 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.289594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd165fe-3fc4-437e-9bda-cfbed248bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.307445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1271/2551] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:40.311122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fcd165fe-3fc4-437e-9bda-cfbed248bb28 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:40.312351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fcd165fe-3fc4-437e-9bda-cfbed248bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:40.319066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e6ef5-45a6-4b4a-9c34-e7420c8dfadc None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:40.320445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3a3e6ef5-45a6-4b4a-9c34-e7420c8dfadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:40.332722 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:40.388160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1281/2552] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:40.392530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e6ef5-45a6-4b4a-9c34-e7420c8dfadc None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:40.398896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd165fe-3fc4-437e-9bda-cfbed248bb28 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:40.461130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:40.462102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.462585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.462953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.478560 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd165fe-3fc4-437e-9bda-cfbed248bb28 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:40.482515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:40.483254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.483644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.484023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.484223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:40.487205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:40.496806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:40.498574 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:40.502629 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1272/2553] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:40.517156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1282/2554] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:41.249340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:41.251050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:41.257161 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:41.259634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:41.275362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45b6b-f653-4f75-869a-ea1c2a222037 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:41.285093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:41.286519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.287006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.287479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] PATH_INFO: `/v3/projects/3182cdea159e42c6999c0dde188fc2e6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.289358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3182cdea159e42c6999c0dde188fc2e6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:41.292943 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:41.303618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221d2cf-d189-42e7-9241-3c91769182fe service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:41.310702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:41.311704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.312295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.312647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] PATH_INFO: `/v3/projects/3de52e6fb4e541fe82780b3c35097ebf` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.314443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de52e6fb4e541fe82780b3c35097ebf)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:41.317504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:41.358156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3182cdea159e42c6999c0dde188fc2e6', 'request_id': 'req-fac67a43-cd1c-415a-8cd7-3243048be9fa'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.365362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3182cdea159e42c6999c0dde188fc2e6', 'request_id': 'req-fac67a43-cd1c-415a-8cd7-3243048be9fa'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.374030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3182cdea159e42c6999c0dde188fc2e6', 'request_id': 'req-fac67a43-cd1c-415a-8cd7-3243048be9fa'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.374347 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de52e6fb4e541fe82780b3c35097ebf', 'request_id': 'req-934e10a2-a254-42ac-8084-2e402d0c3734'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.381990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de52e6fb4e541fe82780b3c35097ebf', 'request_id': 'req-934e10a2-a254-42ac-8084-2e402d0c3734'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.387226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] The token cache is being invalidate because project 3182cdea159e42c6999c0dde188fc2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:41.387510 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.388172 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.389104 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de52e6fb4e541fe82780b3c35097ebf', 'request_id': 'req-934e10a2-a254-42ac-8084-2e402d0c3734'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.389776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1273/2555] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:41 2022] DELETE /identity/v3/projects/3182cdea159e42c6999c0dde188fc2e6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:41.394737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:41.396682 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:41.407694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] The token cache is being invalidate because project 3de52e6fb4e541fe82780b3c35097ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:41.408132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.409308 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.411255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1283/2556] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:41 2022] DELETE /identity/v3/projects/3de52e6fb4e541fe82780b3c35097ebf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:41.415826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:41.417542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:41.422508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:41.496380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67a43-cd1c-415a-8cd7-3243048be9fa admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:41.498133 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:41.516266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e10a2-a254-42ac-8084-2e402d0c3734 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:41.523007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:41.523685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.523972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.524923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] PATH_INFO: `/v3/users/71e410b0baa74547bb0df585518e7565` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.527043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e410b0baa74547bb0df585518e7565)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:41.529272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:41.580069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:41.580733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.581018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.581301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] PATH_INFO: `/v3/users/a1033f0eaf48454a9d71a4474525c0bd` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.582840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1033f0eaf48454a9d71a4474525c0bd)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:41.584794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:41.599435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e410b0baa74547bb0df585518e7565'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.608703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e410b0baa74547bb0df585518e7565'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.609937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e410b0baa74547bb0df585518e7565'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.624330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e410b0baa74547bb0df585518e7565'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.625085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e410b0baa74547bb0df585518e7565'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.646431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1033f0eaf48454a9d71a4474525c0bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.647521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1284/2557] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:41 2022] DELETE /identity/v3/users/71e410b0baa74547bb0df585518e7565 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:41.656974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1033f0eaf48454a9d71a4474525c0bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.658116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1033f0eaf48454a9d71a4474525c0bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.666700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1033f0eaf48454a9d71a4474525c0bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.681120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1033f0eaf48454a9d71a4474525c0bd'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.687632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1274/2558] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:41 2022] DELETE /identity/v3/users/a1033f0eaf48454a9d71a4474525c0bd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:42.052754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.055136 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.100395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.104871 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.166053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09f8ba-1d50-42c2-8eb6-da416e25b340 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.186215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:42.241906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0713c48-dd97-48d7-ae61-74c00a6fad74 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.250165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.251137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.252068 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.252372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.252564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] PATH_INFO: `/v3/projects/8388d2d640334d35ae0ec4cbf699b552` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.253216 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.253557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.253788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] PATH_INFO: `/v3/projects/158c5822e0674eec97fecb456966884b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.254726 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8388d2d640334d35ae0ec4cbf699b552)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.255041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] RBAC: Authorizing `identity:delete_project(project_id=158c5822e0674eec97fecb456966884b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.257808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.259107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.288517 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:42.335314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8388d2d640334d35ae0ec4cbf699b552', 'request_id': 'req-a70969f0-0785-4da5-9898-ff2891bde152'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.343896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158c5822e0674eec97fecb456966884b', 'request_id': 'req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.357835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158c5822e0674eec97fecb456966884b', 'request_id': 'req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.367230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158c5822e0674eec97fecb456966884b', 'request_id': 'req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.369257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8388d2d640334d35ae0ec4cbf699b552', 'request_id': 'req-a70969f0-0785-4da5-9898-ff2891bde152'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.381659 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8388d2d640334d35ae0ec4cbf699b552', 'request_id': 'req-a70969f0-0785-4da5-9898-ff2891bde152'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.383691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] The token cache is being invalidate because project 158c5822e0674eec97fecb456966884b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:42.383995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.384683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8f0cf35d-ad5a-42e9-9acd-81ad266c290c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.386632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1285/2559] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:42 2022] DELETE /identity/v3/projects/158c5822e0674eec97fecb456966884b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:42.392647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2d58a-b38c-4196-9c90-1b576030baea None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.393829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2d58a-b38c-4196-9c90-1b576030baea None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.393829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2d58a-b38c-4196-9c90-1b576030baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.398908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] The token cache is being invalidate because project 8388d2d640334d35ae0ec4cbf699b552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:42.399335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.400125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a70969f0-0785-4da5-9898-ff2891bde152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.401893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1275/2560] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:42 2022] DELETE /identity/v3/projects/8388d2d640334d35ae0ec4cbf699b552 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:42.408011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041607a-b7a3-4b4c-8bad-06aff695c10f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.408668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041607a-b7a3-4b4c-8bad-06aff695c10f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.409152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041607a-b7a3-4b4c-8bad-06aff695c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.417121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3fd2d58a-b38c-4196-9c90-1b576030baea None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:42.418413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3fd2d58a-b38c-4196-9c90-1b576030baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.435511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2041607a-b7a3-4b4c-8bad-06aff695c10f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:42.437013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2041607a-b7a3-4b4c-8bad-06aff695c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.502464 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1286/2561] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:42.509852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1276/2562] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:42.514971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861687-c011-4451-b575-d0bb2f091e7e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.515439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861687-c011-4451-b575-d0bb2f091e7e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.516100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861687-c011-4451-b575-d0bb2f091e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.517900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858396-2dfd-49d4-8114-790a657d5ab9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.518204 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858396-2dfd-49d4-8114-790a657d5ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.518532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858396-2dfd-49d4-8114-790a657d5ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.542989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0a858396-2dfd-49d4-8114-790a657d5ab9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:42.544234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0a858396-2dfd-49d4-8114-790a657d5ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.547435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5e861687-c011-4451-b575-d0bb2f091e7e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:42.549259 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5e861687-c011-4451-b575-d0bb2f091e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.554245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1277/2563] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:42.558609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858396-2dfd-49d4-8114-790a657d5ab9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.558852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1287/2564] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:42.564256 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e861687-c011-4451-b575-d0bb2f091e7e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.569318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858396-2dfd-49d4-8114-790a657d5ab9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.574475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.575191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.575483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.575757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.576413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:42.576718 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.578319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e861687-c011-4451-b575-d0bb2f091e7e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.578492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.585848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.586793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.587207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.587612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.588598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:42.589051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.591174 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1278/2565] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:28:42.592353 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.596558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.606938 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c397f2c-4d72-462a-a638-532a01f3a4a5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.612882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2da4fe-319e-4f04-b99c-94cbd0756868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.613444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da4fe-319e-4f04-b99c-94cbd0756868 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.613659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1288/2566] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:42.614061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da4fe-319e-4f04-b99c-94cbd0756868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.614368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da4fe-319e-4f04-b99c-94cbd0756868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.615102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2da4fe-319e-4f04-b99c-94cbd0756868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.617011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2da4fe-319e-4f04-b99c-94cbd0756868 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.620706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.636710 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e7576-710a-46e3-bfdc-f2307fca1499 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.644542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668747-ae97-4215-aa0f-da4bd05cf1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.645221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668747-ae97-4215-aa0f-da4bd05cf1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.645564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668747-ae97-4215-aa0f-da4bd05cf1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.645995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668747-ae97-4215-aa0f-da4bd05cf1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.647037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668747-ae97-4215-aa0f-da4bd05cf1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.649555 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668747-ae97-4215-aa0f-da4bd05cf1c5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.660119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1279/2567] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:42.662705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2da4fe-319e-4f04-b99c-94cbd0756868 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.700924 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1289/2568] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/projects => generated 407 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:42.705936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:42.708830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668747-ae97-4215-aa0f-da4bd05cf1c5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.755331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2da4fe-319e-4f04-b99c-94cbd0756868 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.797101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668747-ae97-4215-aa0f-da4bd05cf1c5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.804572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d282-f7fb-4d60-887f-3623a3dabd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.805215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d282-f7fb-4d60-887f-3623a3dabd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.805498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d282-f7fb-4d60-887f-3623a3dabd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.805776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d282-f7fb-4d60-887f-3623a3dabd77 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.806469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d282-f7fb-4d60-887f-3623a3dabd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.808426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d282-f7fb-4d60-887f-3623a3dabd77 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.820501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:42.834771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1290/2569] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/users => generated 304 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:42.838997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d282-f7fb-4d60-887f-3623a3dabd77 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.839166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88541d9-f4c4-4dae-a96d-bfc3cb4ab9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.840079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88541d9-f4c4-4dae-a96d-bfc3cb4ab9fd admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.840595 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88541d9-f4c4-4dae-a96d-bfc3cb4ab9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.841102 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88541d9-f4c4-4dae-a96d-bfc3cb4ab9fd admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.842302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88541d9-f4c4-4dae-a96d-bfc3cb4ab9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.846530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88541d9-f4c4-4dae-a96d-bfc3cb4ab9fd admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.850620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d282-f7fb-4d60-887f-3623a3dabd77 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.855452 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397b003-f89b-4491-b9cc-7921712fd082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.856066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b003-f89b-4491-b9cc-7921712fd082 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.856349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b003-f89b-4491-b9cc-7921712fd082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.856645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b003-f89b-4491-b9cc-7921712fd082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.857462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397b003-f89b-4491-b9cc-7921712fd082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.859110 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397b003-f89b-4491-b9cc-7921712fd082 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.874044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1291/2570] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:42.875112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397b003-f89b-4491-b9cc-7921712fd082 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.878161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1280/2571] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/users => generated 282 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:42.882033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88541d9-f4c4-4dae-a96d-bfc3cb4ab9fd admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.885291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397b003-f89b-4491-b9cc-7921712fd082 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.891125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221912-6e72-4743-b59b-0e06b4e0e5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.891774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221912-6e72-4743-b59b-0e06b4e0e5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.892700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221912-6e72-4743-b59b-0e06b4e0e5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.893089 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221912-6e72-4743-b59b-0e06b4e0e5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.893254 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88541d9-f4c4-4dae-a96d-bfc3cb4ab9fd admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.893853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221912-6e72-4743-b59b-0e06b4e0e5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.895587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221912-6e72-4743-b59b-0e06b4e0e5e1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.898352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcce75e-7a2f-4b7e-bcbd-94ba9961148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.898973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce75e-7a2f-4b7e-bcbd-94ba9961148b admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.899260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce75e-7a2f-4b7e-bcbd-94ba9961148b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.899538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce75e-7a2f-4b7e-bcbd-94ba9961148b admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.900195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcce75e-7a2f-4b7e-bcbd-94ba9961148b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.901781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcce75e-7a2f-4b7e-bcbd-94ba9961148b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.906943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1292/2572] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:42.911588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221912-6e72-4743-b59b-0e06b4e0e5e1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.913080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1281/2573] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:42.916983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcce75e-7a2f-4b7e-bcbd-94ba9961148b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.922297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221912-6e72-4743-b59b-0e06b4e0e5e1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.927414 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcce75e-7a2f-4b7e-bcbd-94ba9961148b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.927614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5844fa6-d914-48c7-b8d7-df9d78b6c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.928207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844fa6-d914-48c7-b8d7-df9d78b6c125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.928493 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844fa6-d914-48c7-b8d7-df9d78b6c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.928774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844fa6-d914-48c7-b8d7-df9d78b6c125 admin admin] PATH_INFO: `/v3/projects/ec9d9586c32a46e6a230ad0650bea885/users/7635055470fa4352bdff3aa0c4130719/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.933265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98afd17-e694-4db8-a312-0e3129c55450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.933893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98afd17-e694-4db8-a312-0e3129c55450 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.934180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98afd17-e694-4db8-a312-0e3129c55450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.934489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98afd17-e694-4db8-a312-0e3129c55450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.935125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98afd17-e694-4db8-a312-0e3129c55450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.936768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98afd17-e694-4db8-a312-0e3129c55450 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.947222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5844fa6-d914-48c7-b8d7-df9d78b6c125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9d9586c32a46e6a230ad0650bea885, user_id=7635055470fa4352bdff3aa0c4130719, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.949636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5844fa6-d914-48c7-b8d7-df9d78b6c125 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.957021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1282/2574] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:42.958206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98afd17-e694-4db8-a312-0e3129c55450 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.971043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98afd17-e694-4db8-a312-0e3129c55450 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.974357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1293/2575] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:42 2022] PUT /identity/v3/projects/ec9d9586c32a46e6a230ad0650bea885/users/7635055470fa4352bdff3aa0c4130719/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:42.984264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926066-4f3d-49a3-8783-ebb3a64009a2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.984546 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926066-4f3d-49a3-8783-ebb3a64009a2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.984820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926066-4f3d-49a3-8783-ebb3a64009a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.017994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-52926066-4f3d-49a3-8783-ebb3a64009a2 None None] MFA Rules not processed for user `7635055470fa4352bdff3aa0c4130719`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:43.019799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-52926066-4f3d-49a3-8783-ebb3a64009a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.065184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de19a-35bf-48e0-8ce3-237b51b7bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.066125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de19a-35bf-48e0-8ce3-237b51b7bfee admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.066125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de19a-35bf-48e0-8ce3-237b51b7bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.066722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de19a-35bf-48e0-8ce3-237b51b7bfee admin admin] PATH_INFO: `/v3/projects/ef2d1177c71048268ea0863ae2102bb5/users/2ad48caecfab4a68aad4321f584d92a7/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.084056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de19a-35bf-48e0-8ce3-237b51b7bfee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2d1177c71048268ea0863ae2102bb5, user_id=2ad48caecfab4a68aad4321f584d92a7, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.086788 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de19a-35bf-48e0-8ce3-237b51b7bfee admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.103081 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1283/2576] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:42 2022] PUT /identity/v3/projects/ef2d1177c71048268ea0863ae2102bb5/users/2ad48caecfab4a68aad4321f584d92a7/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:43.112275 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1294/2577] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:43.116155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f370d-3041-4e47-a0b0-20aed2a6d28b None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.116468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f370d-3041-4e47-a0b0-20aed2a6d28b None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.116749 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f370d-3041-4e47-a0b0-20aed2a6d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.116857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926066-4f3d-49a3-8783-ebb3a64009a2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.134141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926066-4f3d-49a3-8783-ebb3a64009a2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.152993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-445f370d-3041-4e47-a0b0-20aed2a6d28b None None] MFA Rules not processed for user `2ad48caecfab4a68aad4321f584d92a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:43.154633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-445f370d-3041-4e47-a0b0-20aed2a6d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.171366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:43.218705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068340a8-e7d4-48d8-bbd0-4a212a1f4003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.219323 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068340a8-e7d4-48d8-bbd0-4a212a1f4003 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.219708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068340a8-e7d4-48d8-bbd0-4a212a1f4003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.220018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068340a8-e7d4-48d8-bbd0-4a212a1f4003 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.221205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068340a8-e7d4-48d8-bbd0-4a212a1f4003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.223176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068340a8-e7d4-48d8-bbd0-4a212a1f4003 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.246085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1284/2578] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:43.250939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f370d-3041-4e47-a0b0-20aed2a6d28b None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.255108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1295/2579] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/projects => generated 407 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:43.259569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068340a8-e7d4-48d8-bbd0-4a212a1f4003 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.268681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f370d-3041-4e47-a0b0-20aed2a6d28b None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.290224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:43.330824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068340a8-e7d4-48d8-bbd0-4a212a1f4003 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.335957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabeba6-a76a-4431-a0ba-e333dab7b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.336573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabeba6-a76a-4431-a0ba-e333dab7b9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.336855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabeba6-a76a-4431-a0ba-e333dab7b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.337121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabeba6-a76a-4431-a0ba-e333dab7b9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.337536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b21b5-f206-4bc9-8aa9-b6687abeb79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.337757 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabeba6-a76a-4431-a0ba-e333dab7b9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.338156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b21b5-f206-4bc9-8aa9-b6687abeb79d admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.338496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b21b5-f206-4bc9-8aa9-b6687abeb79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.338745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b21b5-f206-4bc9-8aa9-b6687abeb79d admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.339383 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b21b5-f206-4bc9-8aa9-b6687abeb79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.339709 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabeba6-a76a-4431-a0ba-e333dab7b9c8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.341815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b21b5-f206-4bc9-8aa9-b6687abeb79d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.365051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1296/2580] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/users => generated 310 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:43.369270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabeba6-a76a-4431-a0ba-e333dab7b9c8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.379218 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1285/2581] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:43.382875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b21b5-f206-4bc9-8aa9-b6687abeb79d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.384542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabeba6-a76a-4431-a0ba-e333dab7b9c8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.456142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920ef33-de3b-4bc6-b7dc-8573625655bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.457414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ef33-de3b-4bc6-b7dc-8573625655bd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.457414 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ef33-de3b-4bc6-b7dc-8573625655bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.457746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ef33-de3b-4bc6-b7dc-8573625655bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.458364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920ef33-de3b-4bc6-b7dc-8573625655bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.460058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920ef33-de3b-4bc6-b7dc-8573625655bd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.478492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1297/2582] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:43.482224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920ef33-de3b-4bc6-b7dc-8573625655bd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.483822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b21b5-f206-4bc9-8aa9-b6687abeb79d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.490117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cd288-8aa9-425c-a226-8a7fe2d6faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.490776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd288-8aa9-425c-a226-8a7fe2d6faef admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.491177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd288-8aa9-425c-a226-8a7fe2d6faef admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.491461 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cd288-8aa9-425c-a226-8a7fe2d6faef admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.492388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cd288-8aa9-425c-a226-8a7fe2d6faef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.494697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cd288-8aa9-425c-a226-8a7fe2d6faef admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.500038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920ef33-de3b-4bc6-b7dc-8573625655bd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.508639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee3c67-9228-4c24-804a-b774490b55e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.509790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee3c67-9228-4c24-804a-b774490b55e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.510331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee3c67-9228-4c24-804a-b774490b55e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.510877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee3c67-9228-4c24-804a-b774490b55e0 admin admin] PATH_INFO: `/v3/projects/0961dd99883b40bfaf557703caa1f9de/users/34e1609ee74e414e89a8c1d98c246952/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.526155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1286/2583] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:43.530831 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cd288-8aa9-425c-a226-8a7fe2d6faef admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.533976 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee3c67-9228-4c24-804a-b774490b55e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0961dd99883b40bfaf557703caa1f9de, user_id=34e1609ee74e414e89a8c1d98c246952, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.537039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee3c67-9228-4c24-804a-b774490b55e0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.549231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cd288-8aa9-425c-a226-8a7fe2d6faef admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.554898 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1298/2584] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:43 2022] PUT /identity/v3/projects/0961dd99883b40bfaf557703caa1f9de/users/34e1609ee74e414e89a8c1d98c246952/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:43.561531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee3c67-9228-4c24-804a-b774490b55e0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.585722 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:43.622684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f693c-ad68-43d2-9dd3-bc1c8fec3709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.623282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f693c-ad68-43d2-9dd3-bc1c8fec3709 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.623665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f693c-ad68-43d2-9dd3-bc1c8fec3709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.623942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f693c-ad68-43d2-9dd3-bc1c8fec3709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.624621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f693c-ad68-43d2-9dd3-bc1c8fec3709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.626285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f693c-ad68-43d2-9dd3-bc1c8fec3709 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.632819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee3c67-9228-4c24-804a-b774490b55e0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.637591 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e337ee-1615-4638-ae88-a6be70dc734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.638127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e337ee-1615-4638-ae88-a6be70dc734d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.641260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e337ee-1615-4638-ae88-a6be70dc734d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.641432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1287/2585] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:43.641547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e337ee-1615-4638-ae88-a6be70dc734d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.641547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e337ee-1615-4638-ae88-a6be70dc734d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.641547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e337ee-1615-4638-ae88-a6be70dc734d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.644854 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f693c-ad68-43d2-9dd3-bc1c8fec3709 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.653938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1299/2586] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:43.656052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f693c-ad68-43d2-9dd3-bc1c8fec3709 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.659082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e337ee-1615-4638-ae88-a6be70dc734d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.662870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349ad2f-5447-477e-a068-d0fc07a77eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.663584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ad2f-5447-477e-a068-d0fc07a77eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.664017 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ad2f-5447-477e-a068-d0fc07a77eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.664507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ad2f-5447-477e-a068-d0fc07a77eef admin admin] PATH_INFO: `/v3/projects/b19c8ae199af47df89ed79e9c8238b39/users/90a191470270445bb016c3a720acb0b1/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.671249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e337ee-1615-4638-ae88-a6be70dc734d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.676224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558aff-3d72-4583-9c01-a91b09cfe740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.677049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558aff-3d72-4583-9c01-a91b09cfe740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.677333 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558aff-3d72-4583-9c01-a91b09cfe740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.677607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558aff-3d72-4583-9c01-a91b09cfe740 admin admin] PATH_INFO: `/v3/projects/0961dd99883b40bfaf557703caa1f9de/users/34e1609ee74e414e89a8c1d98c246952/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.679636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558aff-3d72-4583-9c01-a91b09cfe740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0961dd99883b40bfaf557703caa1f9de, user_id=34e1609ee74e414e89a8c1d98c246952, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.682299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558aff-3d72-4583-9c01-a91b09cfe740 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.683933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349ad2f-5447-477e-a068-d0fc07a77eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19c8ae199af47df89ed79e9c8238b39, user_id=90a191470270445bb016c3a720acb0b1, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.686643 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349ad2f-5447-477e-a068-d0fc07a77eef admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.693400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1300/2587] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:43 2022] PUT /identity/v3/projects/0961dd99883b40bfaf557703caa1f9de/users/34e1609ee74e414e89a8c1d98c246952/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:43.705204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148942ab-4a8c-49bc-bf64-f05fa61e1a53 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.705851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148942ab-4a8c-49bc-bf64-f05fa61e1a53 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.706192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148942ab-4a8c-49bc-bf64-f05fa61e1a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.706444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1288/2588] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:43 2022] PUT /identity/v3/projects/b19c8ae199af47df89ed79e9c8238b39/users/90a191470270445bb016c3a720acb0b1/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:43.710700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349ad2f-5447-477e-a068-d0fc07a77eef admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.729018 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:43.740713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-148942ab-4a8c-49bc-bf64-f05fa61e1a53 None None] MFA Rules not processed for user `34e1609ee74e414e89a8c1d98c246952`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:43.741938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-148942ab-4a8c-49bc-bf64-f05fa61e1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.787319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349ad2f-5447-477e-a068-d0fc07a77eef admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.792470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a7a97-d250-4515-99b2-fff5d0adcd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.793158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a7a97-d250-4515-99b2-fff5d0adcd61 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.793508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a7a97-d250-4515-99b2-fff5d0adcd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.793850 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a7a97-d250-4515-99b2-fff5d0adcd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.794594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a7a97-d250-4515-99b2-fff5d0adcd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.796300 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a7a97-d250-4515-99b2-fff5d0adcd61 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.809877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1289/2589] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:43.816189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a7a97-d250-4515-99b2-fff5d0adcd61 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.827809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a7a97-d250-4515-99b2-fff5d0adcd61 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.833004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f977ce8-102a-490a-ae44-caffec9978e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.833764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977ce8-102a-490a-ae44-caffec9978e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.834041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977ce8-102a-490a-ae44-caffec9978e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.834360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977ce8-102a-490a-ae44-caffec9978e1 admin admin] PATH_INFO: `/v3/projects/b19c8ae199af47df89ed79e9c8238b39/users/90a191470270445bb016c3a720acb0b1/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.838612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f977ce8-102a-490a-ae44-caffec9978e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19c8ae199af47df89ed79e9c8238b39, user_id=90a191470270445bb016c3a720acb0b1, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.841373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1301/2590] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:43.842355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f977ce8-102a-490a-ae44-caffec9978e1 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.853339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148942ab-4a8c-49bc-bf64-f05fa61e1a53 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.854856 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-148942ab-4a8c-49bc-bf64-f05fa61e1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.857051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1290/2591] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:43 2022] PUT /identity/v3/projects/b19c8ae199af47df89ed79e9c8238b39/users/90a191470270445bb016c3a720acb0b1/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:43.868576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c079-9d89-4092-a1d8-6d97cbb75690 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.869571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c079-9d89-4092-a1d8-6d97cbb75690 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.869571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c079-9d89-4092-a1d8-6d97cbb75690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.904044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7ff9c079-9d89-4092-a1d8-6d97cbb75690 None None] MFA Rules not processed for user `90a191470270445bb016c3a720acb0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:43.905530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7ff9c079-9d89-4092-a1d8-6d97cbb75690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.936633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148942ab-4a8c-49bc-bf64-f05fa61e1a53 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.993565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1291/2592] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:43.999266 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638077-65a0-41cd-9d20-05aa47911ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.999891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638077-65a0-41cd-9d20-05aa47911ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:44.000170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638077-65a0-41cd-9d20-05aa47911ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:44.000442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638077-65a0-41cd-9d20-05aa47911ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:44.011575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9c079-9d89-4092-a1d8-6d97cbb75690 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:44.013329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7ff9c079-9d89-4092-a1d8-6d97cbb75690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:44.028398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9c079-9d89-4092-a1d8-6d97cbb75690 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:44.032641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0849e48-f756-4320-baf7-dbdfa5b635b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:44.033277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0849e48-f756-4320-baf7-dbdfa5b635b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:44.033575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0849e48-f756-4320-baf7-dbdfa5b635b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:44.034015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0849e48-f756-4320-baf7-dbdfa5b635b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:44.041958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:44.045730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0849e48-f756-4320-baf7-dbdfa5b635b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:44.056205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0849e48-f756-4320-baf7-dbdfa5b635b5 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:44.067554 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1292/2593] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:44.073713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638077-65a0-41cd-9d20-05aa47911ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:44.075236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638077-65a0-41cd-9d20-05aa47911ea5 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:44.083585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:44.091970 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1302/2594] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:44.161444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0849e48-f756-4320-baf7-dbdfa5b635b5 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:44.172665 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0849e48-f756-4320-baf7-dbdfa5b635b5 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:44.179674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:44.180729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:44.181116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:44.181487 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:44.253597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:44.255108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:44.264868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1293/2595] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:44.313908 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638077-65a0-41cd-9d20-05aa47911ea5 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:44.323126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638077-65a0-41cd-9d20-05aa47911ea5 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:44.327723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259d31-d392-4400-8f17-eca32dade737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:44.328375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259d31-d392-4400-8f17-eca32dade737 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:44.328659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259d31-d392-4400-8f17-eca32dade737 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:44.328936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259d31-d392-4400-8f17-eca32dade737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:44.408643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259d31-d392-4400-8f17-eca32dade737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:44.410982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259d31-d392-4400-8f17-eca32dade737 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:44.424332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1303/2596] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:50.479505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:50.480896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:50.559031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006f98b-620c-4755-8898-8411ff1eef16 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:50.565576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039ddad-1bf4-4aa1-abb4-170cf9d82fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:50.566203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ddad-1bf4-4aa1-abb4-170cf9d82fd2 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:50.566521 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ddad-1bf4-4aa1-abb4-170cf9d82fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:50.566803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ddad-1bf4-4aa1-abb4-170cf9d82fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:50.568602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7039ddad-1bf4-4aa1-abb4-170cf9d82fd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:50.655905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039ddad-1bf4-4aa1-abb4-170cf9d82fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:50.657488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039ddad-1bf4-4aa1-abb4-170cf9d82fd2 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:50.678029 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1294/2597] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:54.082563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259d31-d392-4400-8f17-eca32dade737 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:54.170894 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259d31-d392-4400-8f17-eca32dade737 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:54.177072 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:54.177904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.178383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.178805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] PATH_INFO: `/v3/users/7635055470fa4352bdff3aa0c4130719` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.180380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7635055470fa4352bdff3aa0c4130719)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:54.182656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:54.242767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7635055470fa4352bdff3aa0c4130719'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.253310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7635055470fa4352bdff3aa0c4130719'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.254062 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7635055470fa4352bdff3aa0c4130719'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.265171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7635055470fa4352bdff3aa0c4130719'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.266282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7635055470fa4352bdff3aa0c4130719'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.292108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1304/2598] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:54 2022] DELETE /identity/v3/users/7635055470fa4352bdff3aa0c4130719 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:54.297021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167ad0-e9ce-405b-9081-4327e8f85f79 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.297597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167ad0-e9ce-405b-9081-4327e8f85f79 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.297705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167ad0-e9ce-405b-9081-4327e8f85f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.305028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:54.318791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-95167ad0-e9ce-405b-9081-4327e8f85f79 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:54.320016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-95167ad0-e9ce-405b-9081-4327e8f85f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:54.384786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1295/2599] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:54.396941 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:54.398618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:54.422501 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:54.480131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e518c1-3c46-446e-83ea-a3f6aa10e3f6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:54.484189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae917-a9bf-499d-8471-71aca7edb7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:54.484887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae917-a9bf-499d-8471-71aca7edb7da service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.485164 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae917-a9bf-499d-8471-71aca7edb7da service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.485559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae917-a9bf-499d-8471-71aca7edb7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.497051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae917-a9bf-499d-8471-71aca7edb7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:54.498712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae917-a9bf-499d-8471-71aca7edb7da service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:54.509855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1305/2600] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:54.832586 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95167ad0-e9ce-405b-9081-4327e8f85f79 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:54.834664 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-95167ad0-e9ce-405b-9081-4327e8f85f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:54.855794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95167ad0-e9ce-405b-9081-4327e8f85f79 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:54.865106 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:54.866340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.866845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.867335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] PATH_INFO: `/v3/projects/ec9d9586c32a46e6a230ad0650bea885` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.869602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9d9586c32a46e6a230ad0650bea885)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:54.873419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:54.933700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9d9586c32a46e6a230ad0650bea885', 'request_id': 'req-deff8051-c227-49b3-a49c-fde761df4837'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.941558 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9d9586c32a46e6a230ad0650bea885', 'request_id': 'req-deff8051-c227-49b3-a49c-fde761df4837'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.950472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9d9586c32a46e6a230ad0650bea885', 'request_id': 'req-deff8051-c227-49b3-a49c-fde761df4837'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.964479 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] The token cache is being invalidate because project ec9d9586c32a46e6a230ad0650bea885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:54.964759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.965692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:54.967531 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1296/2601] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:54 2022] DELETE /identity/v3/projects/ec9d9586c32a46e6a230ad0650bea885 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:54.971654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae917-a9bf-499d-8471-71aca7edb7da service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:54.982306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae917-a9bf-499d-8471-71aca7edb7da service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:55.072301 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:55.072936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:55.073217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:55.073490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] PATH_INFO: `/v3/users/34e1609ee74e414e89a8c1d98c246952` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:55.074646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e1609ee74e414e89a8c1d98c246952)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:55.076540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:55.128090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e1609ee74e414e89a8c1d98c246952'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.137324 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e1609ee74e414e89a8c1d98c246952'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.138433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e1609ee74e414e89a8c1d98c246952'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.147570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e1609ee74e414e89a8c1d98c246952'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.148558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33416233-d3e6-4d52-9890-e833f966e6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e1609ee74e414e89a8c1d98c246952'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.176588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1306/2602] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:54 2022] DELETE /identity/v3/users/34e1609ee74e414e89a8c1d98c246952 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:55.637141 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:55.639038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:55.653612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff8051-c227-49b3-a49c-fde761df4837 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:55.726318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:55.726884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:55.727163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:55.727436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] PATH_INFO: `/v3/projects/0961dd99883b40bfaf557703caa1f9de` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:55.728561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0961dd99883b40bfaf557703caa1f9de)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:55.730488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:55.768160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:55.788973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0961dd99883b40bfaf557703caa1f9de', 'request_id': 'req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.796348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0961dd99883b40bfaf557703caa1f9de', 'request_id': 'req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.807194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0961dd99883b40bfaf557703caa1f9de', 'request_id': 'req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.832198 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] The token cache is being invalidate because project 0961dd99883b40bfaf557703caa1f9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:55.832927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.833248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6ac19186-e58e-48ac-a477-ca83ce7b3bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:55.834802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1297/2603] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:55 2022] DELETE /identity/v3/projects/0961dd99883b40bfaf557703caa1f9de => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:55.839655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3f5d3-db59-4213-9658-9987a97b4db7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:55.839953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3f5d3-db59-4213-9658-9987a97b4db7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:55.840251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3f5d3-db59-4213-9658-9987a97b4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:55.862471 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1da3f5d3-db59-4213-9658-9987a97b4db7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:55.863806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1da3f5d3-db59-4213-9658-9987a97b4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:55.905292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:55.938293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1307/2604] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:55.947527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07ba9-83ee-4da3-8297-35cfe01da438 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:55.947815 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07ba9-83ee-4da3-8297-35cfe01da438 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:55.948094 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07ba9-83ee-4da3-8297-35cfe01da438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:55.973681 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2bb07ba9-83ee-4da3-8297-35cfe01da438 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:55.975261 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2bb07ba9-83ee-4da3-8297-35cfe01da438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:55.984530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1298/2605] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:55.992105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3f5d3-db59-4213-9658-9987a97b4db7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:55.993283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb07ba9-83ee-4da3-8297-35cfe01da438 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:55.994992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2bb07ba9-83ee-4da3-8297-35cfe01da438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:56.000197 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3f5d3-db59-4213-9658-9987a97b4db7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.006851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.007157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb07ba9-83ee-4da3-8297-35cfe01da438 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.007876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.008418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.008948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.010079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:56.010747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.012322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17add173-933c-4571-afb0-085485e8983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.013034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17add173-933c-4571-afb0-085485e8983e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.013231 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17add173-933c-4571-afb0-085485e8983e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.013505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17add173-933c-4571-afb0-085485e8983e admin admin] PATH_INFO: `/v3/users/2ad48caecfab4a68aad4321f584d92a7` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.013865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.014805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17add173-933c-4571-afb0-085485e8983e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad48caecfab4a68aad4321f584d92a7)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.016699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17add173-933c-4571-afb0-085485e8983e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.036213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1308/2606] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:56.040848 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.054241 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cd72-2865-468e-8477-487228a78918 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.060049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11921ad-0dd9-41b6-b448-4bfaeb320917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.060692 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11921ad-0dd9-41b6-b448-4bfaeb320917 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.060974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11921ad-0dd9-41b6-b448-4bfaeb320917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.061249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11921ad-0dd9-41b6-b448-4bfaeb320917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.061902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11921ad-0dd9-41b6-b448-4bfaeb320917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.064665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11921ad-0dd9-41b6-b448-4bfaeb320917 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.082159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-17add173-933c-4571-afb0-085485e8983e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad48caecfab4a68aad4321f584d92a7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.092180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-17add173-933c-4571-afb0-085485e8983e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad48caecfab4a68aad4321f584d92a7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.092951 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-17add173-933c-4571-afb0-085485e8983e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad48caecfab4a68aad4321f584d92a7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.103341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1309/2607] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:56 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:56.104125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-17add173-933c-4571-afb0-085485e8983e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad48caecfab4a68aad4321f584d92a7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.104539 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11921ad-0dd9-41b6-b448-4bfaeb320917 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.118192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-17add173-933c-4571-afb0-085485e8983e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad48caecfab4a68aad4321f584d92a7'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.124758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1299/2608] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:55 2022] DELETE /identity/v3/users/2ad48caecfab4a68aad4321f584d92a7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:56.129696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd1e7e-02ce-405a-b2d0-8142801577f4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.129979 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd1e7e-02ce-405a-b2d0-8142801577f4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.130269 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd1e7e-02ce-405a-b2d0-8142801577f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.150394 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-82bd1e7e-02ce-405a-b2d0-8142801577f4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:56.152064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-82bd1e7e-02ce-405a-b2d0-8142801577f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:56.179368 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11921ad-0dd9-41b6-b448-4bfaeb320917 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.219325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1300/2609] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:56.229357 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd1e7e-02ce-405a-b2d0-8142801577f4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.231380 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-82bd1e7e-02ce-405a-b2d0-8142801577f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:56.242812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.243454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.243743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.244053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.244775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.246828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.262716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:56.273498 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1310/2610] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:56 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:56.274432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.276044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:56.287519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc582-f6d4-482b-ada8-5ba5500f4165 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.292141 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2196e-0362-4f6a-9de7-d05cdbb98041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.292736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2196e-0362-4f6a-9de7-d05cdbb98041 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.293016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2196e-0362-4f6a-9de7-d05cdbb98041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.293289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2196e-0362-4f6a-9de7-d05cdbb98041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.293920 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2196e-0362-4f6a-9de7-d05cdbb98041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.295552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2196e-0362-4f6a-9de7-d05cdbb98041 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.299823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd1e7e-02ce-405a-b2d0-8142801577f4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.303449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738973-7854-44ef-9618-9a340a095d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.304052 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738973-7854-44ef-9618-9a340a095d84 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.304334 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738973-7854-44ef-9618-9a340a095d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.304602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738973-7854-44ef-9618-9a340a095d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.306215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1311/2611] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:56.309940 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2196e-0362-4f6a-9de7-d05cdbb98041 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.314843 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738973-7854-44ef-9618-9a340a095d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.316244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738973-7854-44ef-9618-9a340a095d84 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.320064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2196e-0362-4f6a-9de7-d05cdbb98041 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.324617 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a692a98-32b7-4b91-88c9-0f7a046dfccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.325207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692a98-32b7-4b91-88c9-0f7a046dfccd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.325489 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692a98-32b7-4b91-88c9-0f7a046dfccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.325704 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1301/2612] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:56.325803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692a98-32b7-4b91-88c9-0f7a046dfccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.326422 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a692a98-32b7-4b91-88c9-0f7a046dfccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.327989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a692a98-32b7-4b91-88c9-0f7a046dfccd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.339246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1312/2613] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:56.343219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738973-7854-44ef-9618-9a340a095d84 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.353306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738973-7854-44ef-9618-9a340a095d84 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.358550 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b0da5-2a13-4559-bd23-d7687964234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.359637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0da5-2a13-4559-bd23-d7687964234a admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.359974 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0da5-2a13-4559-bd23-d7687964234a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.360430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0da5-2a13-4559-bd23-d7687964234a admin admin] PATH_INFO: `/v3/projects/d444f4b3d94f49e1bd3182d2cca647a9/users/c587177f739141a4a155db88ea560f4a/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.380120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b0da5-2a13-4559-bd23-d7687964234a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d444f4b3d94f49e1bd3182d2cca647a9, user_id=c587177f739141a4a155db88ea560f4a, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.382822 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b0da5-2a13-4559-bd23-d7687964234a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.399160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1302/2614] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:56 2022] PUT /identity/v3/projects/d444f4b3d94f49e1bd3182d2cca647a9/users/c587177f739141a4a155db88ea560f4a/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:56.472287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc1f8-6cb3-4341-9b54-53d4e75fc140 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.472581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc1f8-6cb3-4341-9b54-53d4e75fc140 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.472870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc1f8-6cb3-4341-9b54-53d4e75fc140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.523887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-562bc1f8-6cb3-4341-9b54-53d4e75fc140 None None] MFA Rules not processed for user `c587177f739141a4a155db88ea560f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:56.525976 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-562bc1f8-6cb3-4341-9b54-53d4e75fc140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:56.541653 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:56.638765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1313/2615] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:56.643600 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b0da5-2a13-4559-bd23-d7687964234a admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.678292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bc1f8-6cb3-4341-9b54-53d4e75fc140 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.679787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-562bc1f8-6cb3-4341-9b54-53d4e75fc140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:56.728972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b0da5-2a13-4559-bd23-d7687964234a admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.737560 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b3f7-ef95-4679-9e8b-dae849aa3a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.738490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b3f7-ef95-4679-9e8b-dae849aa3a3d admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.739034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b3f7-ef95-4679-9e8b-dae849aa3a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.739538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b3f7-ef95-4679-9e8b-dae849aa3a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.740687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b3f7-ef95-4679-9e8b-dae849aa3a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.744406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b3f7-ef95-4679-9e8b-dae849aa3a3d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.765865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bc1f8-6cb3-4341-9b54-53d4e75fc140 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.771070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.771715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.771999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.772276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] PATH_INFO: `/v3/projects/ef2d1177c71048268ea0863ae2102bb5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.773410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2d1177c71048268ea0863ae2102bb5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.775590 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.781142 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1303/2616] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:56 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:56.783412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b3f7-ef95-4679-9e8b-dae849aa3a3d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.847380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2d1177c71048268ea0863ae2102bb5', 'request_id': 'req-920cb475-74e1-43a9-880c-a3f4756f0b31'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.853987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2d1177c71048268ea0863ae2102bb5', 'request_id': 'req-920cb475-74e1-43a9-880c-a3f4756f0b31'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.860473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2d1177c71048268ea0863ae2102bb5', 'request_id': 'req-920cb475-74e1-43a9-880c-a3f4756f0b31'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.867829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b3f7-ef95-4679-9e8b-dae849aa3a3d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.883139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] The token cache is being invalidate because project ef2d1177c71048268ea0863ae2102bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:56.883689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.886589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:56.890031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1314/2617] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:56 2022] DELETE /identity/v3/projects/ef2d1177c71048268ea0863ae2102bb5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:56.893503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:56.895375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:56.921355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:56.951717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:56.960723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.961820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.962638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.963224 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.964699 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.968724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:56.978175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb475-74e1-43a9-880c-a3f4756f0b31 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:56.983142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:56.983906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.984190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.984462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] PATH_INFO: `/v3/users/90a191470270445bb016c3a720acb0b1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:56.985693 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a191470270445bb016c3a720acb0b1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:56.988117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.007980 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1304/2618] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:56 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:57.009710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.012445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:57.038991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbebe7-403a-4079-b56d-b8829dec431e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.045814 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:57.046150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a191470270445bb016c3a720acb0b1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.046492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.046779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.047196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.047989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:57.050542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.056577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a191470270445bb016c3a720acb0b1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.057352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a191470270445bb016c3a720acb0b1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.061761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1305/2619] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:57.066791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.068361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a191470270445bb016c3a720acb0b1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.068595 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:57.069435 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a191470270445bb016c3a720acb0b1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.083468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5c87c-3621-4b99-9b0f-2b9c2d51c164 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.088711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dd2e5-05fd-46cc-9867-50056b51e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:57.089355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dd2e5-05fd-46cc-9867-50056b51e851 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.089610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dd2e5-05fd-46cc-9867-50056b51e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.089886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dd2e5-05fd-46cc-9867-50056b51e851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.090570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dd2e5-05fd-46cc-9867-50056b51e851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:57.092154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dd2e5-05fd-46cc-9867-50056b51e851 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.096473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1315/2620] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:56 2022] DELETE /identity/v3/users/90a191470270445bb016c3a720acb0b1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:57.106347 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1306/2621] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:57.112622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.193331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf261-0f07-4e9b-b609-a2ce0bf6a8fa admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.199309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e07ee2-5ca4-491a-8b13-b56ee0e9f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:57.199562 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e07ee2-5ca4-491a-8b13-b56ee0e9f22b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.199874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e07ee2-5ca4-491a-8b13-b56ee0e9f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.200158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e07ee2-5ca4-491a-8b13-b56ee0e9f22b admin admin] PATH_INFO: `/v3/projects/f9dd7cdfd6c54b00b4bfbfa33e12101d/users/5fe49ef827be4002befc8da7c0b15b84/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.219570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e07ee2-5ca4-491a-8b13-b56ee0e9f22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dd7cdfd6c54b00b4bfbfa33e12101d, user_id=5fe49ef827be4002befc8da7c0b15b84, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:57.223090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e07ee2-5ca4-491a-8b13-b56ee0e9f22b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.245120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1316/2622] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:57 2022] PUT /identity/v3/projects/f9dd7cdfd6c54b00b4bfbfa33e12101d/users/5fe49ef827be4002befc8da7c0b15b84/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:57.255571 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cedfb-87f0-4a1f-8e87-90abe1387f12 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.256096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cedfb-87f0-4a1f-8e87-90abe1387f12 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.256482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cedfb-87f0-4a1f-8e87-90abe1387f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.297036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f68cedfb-87f0-4a1f-8e87-90abe1387f12 None None] MFA Rules not processed for user `5fe49ef827be4002befc8da7c0b15b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:57.299351 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f68cedfb-87f0-4a1f-8e87-90abe1387f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:57.382557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1307/2623] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:57.387044 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e07ee2-5ca4-491a-8b13-b56ee0e9f22b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.426666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cedfb-87f0-4a1f-8e87-90abe1387f12 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.429693 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f68cedfb-87f0-4a1f-8e87-90abe1387f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:57.446148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:57.483271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e07ee2-5ca4-491a-8b13-b56ee0e9f22b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.489213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb594d2c-9fd2-4a05-9a08-b7a4732e506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:57.489843 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb594d2c-9fd2-4a05-9a08-b7a4732e506a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.490130 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb594d2c-9fd2-4a05-9a08-b7a4732e506a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.490459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb594d2c-9fd2-4a05-9a08-b7a4732e506a admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.491107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb594d2c-9fd2-4a05-9a08-b7a4732e506a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:57.493064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb594d2c-9fd2-4a05-9a08-b7a4732e506a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.537231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1317/2624] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:57 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:57.541350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb594d2c-9fd2-4a05-9a08-b7a4732e506a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.545905 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cedfb-87f0-4a1f-8e87-90abe1387f12 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.617926 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:57.656779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:57.657510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb594d2c-9fd2-4a05-9a08-b7a4732e506a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.658562 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.660055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.660055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] PATH_INFO: `/v3/projects/b19c8ae199af47df89ed79e9c8238b39` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.662838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19c8ae199af47df89ed79e9c8238b39)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:57.665501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.666116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d5aa2-15b0-4dfd-b6ff-4b07b8c2581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:57.666793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d5aa2-15b0-4dfd-b6ff-4b07b8c2581a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.667070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d5aa2-15b0-4dfd-b6ff-4b07b8c2581a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.669640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d5aa2-15b0-4dfd-b6ff-4b07b8c2581a admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.671082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d5aa2-15b0-4dfd-b6ff-4b07b8c2581a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:57.673184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d5aa2-15b0-4dfd-b6ff-4b07b8c2581a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.724929 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19c8ae199af47df89ed79e9c8238b39', 'request_id': 'req-c14b87c2-b9ca-4b40-a253-236a1ce54403'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.727095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1318/2625] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:57 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:57.731014 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d5aa2-15b0-4dfd-b6ff-4b07b8c2581a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.734340 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19c8ae199af47df89ed79e9c8238b39', 'request_id': 'req-c14b87c2-b9ca-4b40-a253-236a1ce54403'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.742652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d5aa2-15b0-4dfd-b6ff-4b07b8c2581a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.743598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19c8ae199af47df89ed79e9c8238b39', 'request_id': 'req-c14b87c2-b9ca-4b40-a253-236a1ce54403'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.760211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] The token cache is being invalidate because project b19c8ae199af47df89ed79e9c8238b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:57.760505 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.761293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c14b87c2-b9ca-4b40-a253-236a1ce54403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:57.763073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1308/2626] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:57 2022] DELETE /identity/v3/projects/b19c8ae199af47df89ed79e9c8238b39 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:57.771127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56615beb-8741-48ed-9dc9-b6331c6b6f9f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.771631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56615beb-8741-48ed-9dc9-b6331c6b6f9f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.772120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56615beb-8741-48ed-9dc9-b6331c6b6f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.796507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-56615beb-8741-48ed-9dc9-b6331c6b6f9f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:57.797735 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-56615beb-8741-48ed-9dc9-b6331c6b6f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:57.812716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:57.813321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.813600 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.813873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.814611 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:57.816240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.827541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1319/2627] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:57.841270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.843121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:57.856033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ed75b-6e6a-40ab-be55-da61acf3f269 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.860767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720788c-0bec-40cd-a0a8-9eeef576bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:57.862169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720788c-0bec-40cd-a0a8-9eeef576bd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.862509 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720788c-0bec-40cd-a0a8-9eeef576bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.862791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720788c-0bec-40cd-a0a8-9eeef576bd0f admin admin] PATH_INFO: `/v3/projects/b00db9c8339f43e7b4956df7589dc538/users/ea10e1d62b6e41439dbb80c77e08e77e/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.866786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1309/2628] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:57.874330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a272a79-00e8-4515-8623-c3a5e01ce5c9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:57.874626 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a272a79-00e8-4515-8623-c3a5e01ce5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:57.874906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a272a79-00e8-4515-8623-c3a5e01ce5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.879318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720788c-0bec-40cd-a0a8-9eeef576bd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00db9c8339f43e7b4956df7589dc538, user_id=ea10e1d62b6e41439dbb80c77e08e77e, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:57.882019 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720788c-0bec-40cd-a0a8-9eeef576bd0f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:57.896332 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1320/2629] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:57 2022] PUT /identity/v3/projects/b00db9c8339f43e7b4956df7589dc538/users/ea10e1d62b6e41439dbb80c77e08e77e/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:57.900968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720788c-0bec-40cd-a0a8-9eeef576bd0f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.903657 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2a272a79-00e8-4515-8623-c3a5e01ce5c9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:57.904885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2a272a79-00e8-4515-8623-c3a5e01ce5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:57.943131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:57.979423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1310/2630] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:57.983761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a272a79-00e8-4515-8623-c3a5e01ce5c9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:57.989027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720788c-0bec-40cd-a0a8-9eeef576bd0f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:57.994713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a272a79-00e8-4515-8623-c3a5e01ce5c9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.004564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cc974-e5ec-4822-803f-2ffc672640b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.005299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cc974-e5ec-4822-803f-2ffc672640b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.005455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.005578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cc974-e5ec-4822-803f-2ffc672640b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.005842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cc974-e5ec-4822-803f-2ffc672640b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.005989 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.006294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.006524 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cc974-e5ec-4822-803f-2ffc672640b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.006639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.007242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:58.007545 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.008120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cc974-e5ec-4822-803f-2ffc672640b1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.009119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.011901 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:58.022420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1311/2631] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:58.024208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1321/2632] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:58.025679 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.031647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cc974-e5ec-4822-803f-2ffc672640b1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.038030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e346a-77ca-4f59-9ba7-f93b27a5a84c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.041828 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cc974-e5ec-4822-803f-2ffc672640b1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.042834 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00962cf0-4ab3-4f42-b125-3fad9f84aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.043484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962cf0-4ab3-4f42-b125-3fad9f84aaab admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.043830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962cf0-4ab3-4f42-b125-3fad9f84aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.044073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00962cf0-4ab3-4f42-b125-3fad9f84aaab admin admin] PATH_INFO: `/v3/projects/b00db9c8339f43e7b4956df7589dc538/users/ea10e1d62b6e41439dbb80c77e08e77e/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.046088 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00962cf0-4ab3-4f42-b125-3fad9f84aaab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00db9c8339f43e7b4956df7589dc538, user_id=ea10e1d62b6e41439dbb80c77e08e77e, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.046864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792079-4139-43c0-8c0d-f35f78317807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.047466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792079-4139-43c0-8c0d-f35f78317807 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.047750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792079-4139-43c0-8c0d-f35f78317807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.048029 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792079-4139-43c0-8c0d-f35f78317807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.049290 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00962cf0-4ab3-4f42-b125-3fad9f84aaab admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.049510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792079-4139-43c0-8c0d-f35f78317807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.051481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792079-4139-43c0-8c0d-f35f78317807 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.061737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1312/2633] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:58 2022] PUT /identity/v3/projects/b00db9c8339f43e7b4956df7589dc538/users/ea10e1d62b6e41439dbb80c77e08e77e/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:58.074518 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21301-62ff-4469-a3d1-c8cb99ddf239 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.074879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21301-62ff-4469-a3d1-c8cb99ddf239 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.075161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21301-62ff-4469-a3d1-c8cb99ddf239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.085144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1322/2634] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:58 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:58.086248 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792079-4139-43c0-8c0d-f35f78317807 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.107474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-56c21301-62ff-4469-a3d1-c8cb99ddf239 None None] MFA Rules not processed for user `ea10e1d62b6e41439dbb80c77e08e77e`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:58.108702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-56c21301-62ff-4469-a3d1-c8cb99ddf239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:58.156055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792079-4139-43c0-8c0d-f35f78317807 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.161310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f15cfb-b19f-4502-aac1-7982f6b02840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.161964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f15cfb-b19f-4502-aac1-7982f6b02840 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.162298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f15cfb-b19f-4502-aac1-7982f6b02840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.162613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f15cfb-b19f-4502-aac1-7982f6b02840 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.163239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f15cfb-b19f-4502-aac1-7982f6b02840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.165322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f15cfb-b19f-4502-aac1-7982f6b02840 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.187137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1313/2635] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:58.192189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1323/2636] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:58 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:58.196246 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c21301-62ff-4469-a3d1-c8cb99ddf239 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.196397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f15cfb-b19f-4502-aac1-7982f6b02840 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.197619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-56c21301-62ff-4469-a3d1-c8cb99ddf239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:58.207340 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f15cfb-b19f-4502-aac1-7982f6b02840 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.212242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96217d11-a858-40ca-b185-ff901e339e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.212953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217d11-a858-40ca-b185-ff901e339e08 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.213234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217d11-a858-40ca-b185-ff901e339e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.213510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217d11-a858-40ca-b185-ff901e339e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.214154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217d11-a858-40ca-b185-ff901e339e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.215874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217d11-a858-40ca-b185-ff901e339e08 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.226852 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1324/2637] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:58.230971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96217d11-a858-40ca-b185-ff901e339e08 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.245854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96217d11-a858-40ca-b185-ff901e339e08 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.251109 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c2df-8c85-431c-895d-d53c8306e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.251877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c2df-8c85-431c-895d-d53c8306e789 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.252093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c2df-8c85-431c-895d-d53c8306e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.252619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c2df-8c85-431c-895d-d53c8306e789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.253369 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1c2df-8c85-431c-895d-d53c8306e789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.255111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1c2df-8c85-431c-895d-d53c8306e789 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.264024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c21301-62ff-4469-a3d1-c8cb99ddf239 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.268927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1325/2638] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:58.273575 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.273786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c2df-8c85-431c-895d-d53c8306e789 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.274294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.274674 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.274910 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.276711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:58.284812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c2df-8c85-431c-895d-d53c8306e789 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.290045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2d48c-f975-4230-b4bd-a19bfb8da3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.290714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d48c-f975-4230-b4bd-a19bfb8da3df admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.290714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d48c-f975-4230-b4bd-a19bfb8da3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.291088 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d48c-f975-4230-b4bd-a19bfb8da3df admin admin] PATH_INFO: `/v3/projects/6b35353eb3fa47c3913dbeace8d1fa3a/users/333831f1f41d4b0bb0378f419e5b8ac2/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.307373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2d48c-f975-4230-b4bd-a19bfb8da3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b35353eb3fa47c3913dbeace8d1fa3a, user_id=333831f1f41d4b0bb0378f419e5b8ac2, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.310080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2d48c-f975-4230-b4bd-a19bfb8da3df admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.327765 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1326/2639] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:58 2022] PUT /identity/v3/projects/6b35353eb3fa47c3913dbeace8d1fa3a/users/333831f1f41d4b0bb0378f419e5b8ac2/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:58.354222 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.356163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.367377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1314/2640] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:58.398993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1a0f-cdc0-4e5c-8944-46064e696415 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.399327 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1a0f-cdc0-4e5c-8944-46064e696415 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.399551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1a0f-cdc0-4e5c-8944-46064e696415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.429217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fd3a1a0f-cdc0-4e5c-8944-46064e696415 None None] MFA Rules not processed for user `333831f1f41d4b0bb0378f419e5b8ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:58.430515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fd3a1a0f-cdc0-4e5c-8944-46064e696415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:58.473512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:58.503514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1327/2641] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:58.508765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.521522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe87f6e-7ffa-4c7b-945e-007e5c3c1cf7 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.542755 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:58.594232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0874-2e9d-449f-a034-56e4aae00157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.594932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0874-2e9d-449f-a034-56e4aae00157 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.595239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0874-2e9d-449f-a034-56e4aae00157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.596161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0874-2e9d-449f-a034-56e4aae00157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.597105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff0874-2e9d-449f-a034-56e4aae00157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.599066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff0874-2e9d-449f-a034-56e4aae00157 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.630309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1315/2642] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:58 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:58.634933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a1a0f-cdc0-4e5c-8944-46064e696415 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.646602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a1a0f-cdc0-4e5c-8944-46064e696415 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.756723 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68feb344-c2fb-4291-a5cf-c370772fbf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.757311 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb344-c2fb-4291-a5cf-c370772fbf49 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.758405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb344-c2fb-4291-a5cf-c370772fbf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.758911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb344-c2fb-4291-a5cf-c370772fbf49 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.761051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68feb344-c2fb-4291-a5cf-c370772fbf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.763348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68feb344-c2fb-4291-a5cf-c370772fbf49 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.794525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1328/2643] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:58 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:58.799144 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0874-2e9d-449f-a034-56e4aae00157 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.811055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0874-2e9d-449f-a034-56e4aae00157 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.819284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf263-75fe-473b-a4b8-89629afa8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.819942 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf263-75fe-473b-a4b8-89629afa8f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.820333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf263-75fe-473b-a4b8-89629afa8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.820680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf263-75fe-473b-a4b8-89629afa8f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.821389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bf263-75fe-473b-a4b8-89629afa8f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.823079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bf263-75fe-473b-a4b8-89629afa8f3d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.836274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1316/2644] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:58.840887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68feb344-c2fb-4291-a5cf-c370772fbf49 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.852618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68feb344-c2fb-4291-a5cf-c370772fbf49 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.858885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b733e-7b43-449a-86f4-8d4519785038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.859737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b733e-7b43-449a-86f4-8d4519785038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.860175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b733e-7b43-449a-86f4-8d4519785038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.860531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b733e-7b43-449a-86f4-8d4519785038 admin admin] PATH_INFO: `/v3/projects/df576cd23d1647069b344e87f5c12ad3/users/5ee9420d1a564309a1c4bdccc8a07f9d/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.877719 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b733e-7b43-449a-86f4-8d4519785038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df576cd23d1647069b344e87f5c12ad3, user_id=5ee9420d1a564309a1c4bdccc8a07f9d, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.881577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b733e-7b43-449a-86f4-8d4519785038 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:58.898822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1329/2645] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:58 2022] PUT /identity/v3/projects/df576cd23d1647069b344e87f5c12ad3/users/5ee9420d1a564309a1c4bdccc8a07f9d/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:58.903592 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf263-75fe-473b-a4b8-89629afa8f3d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:58.914723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf263-75fe-473b-a4b8-89629afa8f3d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:58.990511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:58.991117 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:58.991406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:58.991684 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:58.992315 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:58.993893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:59.004217 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1317/2646] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:59.008281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b733e-7b43-449a-86f4-8d4519785038 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:59.013936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:59.015630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:59.018810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b733e-7b43-449a-86f4-8d4519785038 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:59.023528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd7429-db87-4602-a38e-be3540bb7c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:59.024230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7429-db87-4602-a38e-be3540bb7c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:59.024536 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7429-db87-4602-a38e-be3540bb7c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:59.024819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd7429-db87-4602-a38e-be3540bb7c2f admin admin] PATH_INFO: `/v3/projects/df576cd23d1647069b344e87f5c12ad3/users/5ee9420d1a564309a1c4bdccc8a07f9d/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:59.026847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd7429-db87-4602-a38e-be3540bb7c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df576cd23d1647069b344e87f5c12ad3, user_id=5ee9420d1a564309a1c4bdccc8a07f9d, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:59.029647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd7429-db87-4602-a38e-be3540bb7c2f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:59.042123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1330/2647] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:59 2022] PUT /identity/v3/projects/df576cd23d1647069b344e87f5c12ad3/users/5ee9420d1a564309a1c4bdccc8a07f9d/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:59.052916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d45378-e240-457e-ac09-058cb4d7cec9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:59.053207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d45378-e240-457e-ac09-058cb4d7cec9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:59.053488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d45378-e240-457e-ac09-058cb4d7cec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:59.083696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d1d45378-e240-457e-ac09-058cb4d7cec9 None None] MFA Rules not processed for user `5ee9420d1a564309a1c4bdccc8a07f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:59.084921 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d1d45378-e240-457e-ac09-058cb4d7cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:59.096566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce3dc7-1e75-4f6f-950a-51bda574b5db admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:59.132786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:59.163379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1331/2648] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:28:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:59.177991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d45378-e240-457e-ac09-058cb4d7cec9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:59.180139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:59.180775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:59.181053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:59.181354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:59.183390 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:59.195832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:59.247385 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d45378-e240-457e-ac09-058cb4d7cec9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:59.251196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56799da-48fd-4993-a451-53bb69c65d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:59.251817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56799da-48fd-4993-a451-53bb69c65d6e service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:59.252103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56799da-48fd-4993-a451-53bb69c65d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:59.252375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56799da-48fd-4993-a451-53bb69c65d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:59.261742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:59.263846 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:59.265068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56799da-48fd-4993-a451-53bb69c65d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:59.266943 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56799da-48fd-4993-a451-53bb69c65d6e service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:59.274062 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1318/2649] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:59.277146 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1332/2650] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:59.613738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:59.624189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f7ea-aeb6-438a-a96b-0fa76a2a1566 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:59.630630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ee9420d1a564309a1c4bdccc8a07f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df576cd23d1647069b344e87f5c12ad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:59.631803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:59.632103 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:59.632386 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:59.633073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:59.633379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:59.635097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:59.648424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1319/2651] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:59.652641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56799da-48fd-4993-a451-53bb69c65d6e service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:59.662938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56799da-48fd-4993-a451-53bb69c65d6e service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:59.667815 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec5ca3-c2f5-4662-924b-1377dc0dadbd tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ee9420d1a564309a1c4bdccc8a07f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df576cd23d1647069b344e87f5c12ad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:59.668427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec5ca3-c2f5-4662-924b-1377dc0dadbd tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:59.668714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec5ca3-c2f5-4662-924b-1377dc0dadbd tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:59.668993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec5ca3-c2f5-4662-924b-1377dc0dadbd tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:59.669637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec5ca3-c2f5-4662-924b-1377dc0dadbd tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:59.671566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec5ca3-c2f5-4662-924b-1377dc0dadbd tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:59.702051 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1333/2652] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:59 2022] POST /identity/v3/projects => generated 353 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:59.707567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:59.718058 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4151d-fd4b-415b-a514-08e45ca8b839 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:59.776260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ee9420d1a564309a1c4bdccc8a07f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df576cd23d1647069b344e87f5c12ad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:59.776899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:59.777191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:59.777774 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:59.778379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:59.778696 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:59.780321 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:59.793964 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1320/2653] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:59.837330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec5ca3-c2f5-4662-924b-1377dc0dadbd tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:59.860058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec5ca3-c2f5-4662-924b-1377dc0dadbd tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:59.889472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ee9420d1a564309a1c4bdccc8a07f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df576cd23d1647069b344e87f5c12ad3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:59.890135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:59.890884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:59.891172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] PATH_INFO: `/v3/projects/4b5dd48323704b62931980921e70b482` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:59.902320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4b5dd48323704b62931980921e70b482)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:59.902320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:59.975054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5dd48323704b62931980921e70b482', 'request_id': 'req-38670956-10b4-468c-ad61-0a38b73da388'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:59.981881 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5dd48323704b62931980921e70b482', 'request_id': 'req-38670956-10b4-468c-ad61-0a38b73da388'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:59.990015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:59.990631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5dd48323704b62931980921e70b482', 'request_id': 'req-38670956-10b4-468c-ad61-0a38b73da388'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:00.007339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] The token cache is being invalidate because project 4b5dd48323704b62931980921e70b482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:00.007689 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:00.008465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:00.010483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1334/2654] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:59 2022] DELETE /identity/v3/projects/4b5dd48323704b62931980921e70b482 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:00.062130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:00.068314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926d80-00ea-41e5-9d04-0f42d10b8ada tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:00.127576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac1a99-942f-41f5-994e-605e3264d7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:00.128476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac1a99-942f-41f5-994e-605e3264d7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:00.128756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac1a99-942f-41f5-994e-605e3264d7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:00.129030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac1a99-942f-41f5-994e-605e3264d7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:00.131588 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ebac1a99-942f-41f5-994e-605e3264d7a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:00.200896 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac1a99-942f-41f5-994e-605e3264d7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:00.202529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac1a99-942f-41f5-994e-605e3264d7a8 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:00.213045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1321/2655] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:00.227601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:00.229045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:00.311521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38670956-10b4-468c-ad61-0a38b73da388 tempest-VolumeQuotaClassesTest-686258751 tempest-VolumeQuotaClassesTest-686258751-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:00.317544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:00.318236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:00.318566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:00.318845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] PATH_INFO: `/v3/users/333831f1f41d4b0bb0378f419e5b8ac2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:00.320151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333831f1f41d4b0bb0378f419e5b8ac2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:00.322165 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:00.349589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:00.385558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333831f1f41d4b0bb0378f419e5b8ac2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:00.400523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333831f1f41d4b0bb0378f419e5b8ac2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:00.401306 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333831f1f41d4b0bb0378f419e5b8ac2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:00.411707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333831f1f41d4b0bb0378f419e5b8ac2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:00.412496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333831f1f41d4b0bb0378f419e5b8ac2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:00.438548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1335/2656] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:00 2022] DELETE /identity/v3/users/333831f1f41d4b0bb0378f419e5b8ac2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:00.443057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a3c36-7b94-4a21-a9a3-4d5ebf187c04 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:00.443278 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a3c36-7b94-4a21-a9a3-4d5ebf187c04 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:00.443581 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a3c36-7b94-4a21-a9a3-4d5ebf187c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:00.466086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-f96a3c36-7b94-4a21-a9a3-4d5ebf187c04 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:00.467372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f96a3c36-7b94-4a21-a9a3-4d5ebf187c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:00.549273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1322/2657] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:00.556075 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:00.557667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:00.633742 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309811-3d68-4860-99f2-40a70586a2b8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:00.640012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:00.640953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:00.641228 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:00.641506 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:00.652788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:00.654234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:00.667804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1336/2658] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:00.837820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a3c36-7b94-4a21-a9a3-4d5ebf187c04 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:00.839363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f96a3c36-7b94-4a21-a9a3-4d5ebf187c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:00.899845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a3c36-7b94-4a21-a9a3-4d5ebf187c04 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:00.904441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:00.905244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:00.905530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:00.905807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:00.908584 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:00.927283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:00.974373 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:00.976244 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:01.015129 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:01.016866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:01.019803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3044a2e-0c19-424c-93de-36c14cb2684e service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:01.025297 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:01.026073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:01.026465 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:01.026835 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] PATH_INFO: `/v3/projects/6b35353eb3fa47c3913dbeace8d1fa3a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:01.028083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b35353eb3fa47c3913dbeace8d1fa3a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:01.030173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:01.041859 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1323/2659] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:01.093458 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b35353eb3fa47c3913dbeace8d1fa3a', 'request_id': 'req-47e46fa1-287b-40f3-bcc1-d70898a9195b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.102759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b35353eb3fa47c3913dbeace8d1fa3a', 'request_id': 'req-47e46fa1-287b-40f3-bcc1-d70898a9195b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.110712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b35353eb3fa47c3913dbeace8d1fa3a', 'request_id': 'req-47e46fa1-287b-40f3-bcc1-d70898a9195b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.152775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] The token cache is being invalidate because project 6b35353eb3fa47c3913dbeace8d1fa3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:01.153103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.154444 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.156636 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1337/2660] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:00 2022] DELETE /identity/v3/projects/6b35353eb3fa47c3913dbeace8d1fa3a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:01.161786 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:01.175800 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fce914-c5ef-451c-ba96-a47089cb5b5a service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:01.251820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:01.252917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:01.253421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:01.253916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] PATH_INFO: `/v3/users/5ee9420d1a564309a1c4bdccc8a07f9d` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:01.255568 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee9420d1a564309a1c4bdccc8a07f9d)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:01.258051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:01.320024 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee9420d1a564309a1c4bdccc8a07f9d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.327161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee9420d1a564309a1c4bdccc8a07f9d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.327852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee9420d1a564309a1c4bdccc8a07f9d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.335751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee9420d1a564309a1c4bdccc8a07f9d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.349535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-05fefe35-bf26-4ac1-aa0b-cb87d2c8ecff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee9420d1a564309a1c4bdccc8a07f9d'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.356097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1324/2661] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:01 2022] DELETE /identity/v3/users/5ee9420d1a564309a1c4bdccc8a07f9d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:01.672959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:01.674499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:01.687566 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e46fa1-287b-40f3-bcc1-d70898a9195b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:01.710426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:01.752870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:01.753504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:01.753786 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:01.754127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] PATH_INFO: `/v3/projects/df576cd23d1647069b344e87f5c12ad3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:01.755223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df576cd23d1647069b344e87f5c12ad3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:01.757138 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:01.807705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df576cd23d1647069b344e87f5c12ad3', 'request_id': 'req-70ce0873-2989-4544-a27b-fe60e1fa9718'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.814678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df576cd23d1647069b344e87f5c12ad3', 'request_id': 'req-70ce0873-2989-4544-a27b-fe60e1fa9718'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.820271 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df576cd23d1647069b344e87f5c12ad3', 'request_id': 'req-70ce0873-2989-4544-a27b-fe60e1fa9718'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.833534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] The token cache is being invalidate because project df576cd23d1647069b344e87f5c12ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:01.833829 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.834657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-70ce0873-2989-4544-a27b-fe60e1fa9718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:01.836200 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1338/2662] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:01 2022] DELETE /identity/v3/projects/df576cd23d1647069b344e87f5c12ad3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:01.841875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66fae-4f16-48b3-8a32-d80606db29e0 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:01.842196 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66fae-4f16-48b3-8a32-d80606db29e0 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:01.842636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66fae-4f16-48b3-8a32-d80606db29e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:01.865897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-24b66fae-4f16-48b3-8a32-d80606db29e0 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:01.867241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-24b66fae-4f16-48b3-8a32-d80606db29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:01.891197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:01.934061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1325/2663] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:01.943425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a48aef-df67-4977-8edf-d34a70c7d25e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:01.943712 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a48aef-df67-4977-8edf-d34a70c7d25e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:01.944010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a48aef-df67-4977-8edf-d34a70c7d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:01.964638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-67a48aef-df67-4977-8edf-d34a70c7d25e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:01.965842 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-67a48aef-df67-4977-8edf-d34a70c7d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:01.973750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1339/2664] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:01.978033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b66fae-4f16-48b3-8a32-d80606db29e0 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:01.987710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b66fae-4f16-48b3-8a32-d80606db29e0 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:01.992197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:01.992791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:01.993072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:01.993345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:01.993983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:29:01.994307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:01.995886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.013120 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1326/2665] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:29:02.018425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a48aef-df67-4977-8edf-d34a70c7d25e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.027727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a48aef-df67-4977-8edf-d34a70c7d25e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.032578 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2119e-b7f6-4e6a-a0f7-0bf98d7a69d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.033580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2119e-b7f6-4e6a-a0f7-0bf98d7a69d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.033841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2119e-b7f6-4e6a-a0f7-0bf98d7a69d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.034114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2119e-b7f6-4e6a-a0f7-0bf98d7a69d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.034776 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2119e-b7f6-4e6a-a0f7-0bf98d7a69d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.036664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2119e-b7f6-4e6a-a0f7-0bf98d7a69d6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.066845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1340/2666] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:02 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:02.071066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.083151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d457c-8f39-4c8d-95e6-407a1e44f285 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.151035 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43d1c-9f8b-4118-8ade-c568f7b0fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.151645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43d1c-9f8b-4118-8ade-c568f7b0fe43 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.151955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43d1c-9f8b-4118-8ade-c568f7b0fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.152352 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43d1c-9f8b-4118-8ade-c568f7b0fe43 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.152897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd43d1c-9f8b-4118-8ade-c568f7b0fe43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.154837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd43d1c-9f8b-4118-8ade-c568f7b0fe43 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.192288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1327/2667] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:02 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:02.193886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2119e-b7f6-4e6a-a0f7-0bf98d7a69d6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.226635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2119e-b7f6-4e6a-a0f7-0bf98d7a69d6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.231865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce16f62-efc0-4a67-92f2-0ec0db8f2f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.232752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce16f62-efc0-4a67-92f2-0ec0db8f2f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.233121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce16f62-efc0-4a67-92f2-0ec0db8f2f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.233484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce16f62-efc0-4a67-92f2-0ec0db8f2f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.248887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce16f62-efc0-4a67-92f2-0ec0db8f2f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.250605 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce16f62-efc0-4a67-92f2-0ec0db8f2f13 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.272336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1341/2668] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:02.276284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43d1c-9f8b-4118-8ade-c568f7b0fe43 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.288298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43d1c-9f8b-4118-8ade-c568f7b0fe43 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.293228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88071-8774-4ea6-977b-056c07dde525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.293842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88071-8774-4ea6-977b-056c07dde525 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.294201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88071-8774-4ea6-977b-056c07dde525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.294442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88071-8774-4ea6-977b-056c07dde525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.295093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d88071-8774-4ea6-977b-056c07dde525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.296723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d88071-8774-4ea6-977b-056c07dde525 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.310314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1328/2669] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:29:02.316412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce16f62-efc0-4a67-92f2-0ec0db8f2f13 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.326900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce16f62-efc0-4a67-92f2-0ec0db8f2f13 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.333194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0175-435e-4bf1-b892-9bcd404e44f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.333867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0175-435e-4bf1-b892-9bcd404e44f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.334153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0175-435e-4bf1-b892-9bcd404e44f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.334473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c0175-435e-4bf1-b892-9bcd404e44f9 admin admin] PATH_INFO: `/v3/projects/8e2030b73a06484f8e7b867b7b7a2698/users/9abcaa46fe594b329bc9e18fd2f3086f/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.350538 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c0175-435e-4bf1-b892-9bcd404e44f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2030b73a06484f8e7b867b7b7a2698, user_id=9abcaa46fe594b329bc9e18fd2f3086f, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.353210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c0175-435e-4bf1-b892-9bcd404e44f9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.367140 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1342/2670] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:02 2022] PUT /identity/v3/projects/8e2030b73a06484f8e7b867b7b7a2698/users/9abcaa46fe594b329bc9e18fd2f3086f/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:02.380154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0358ae-e4b8-40e3-85b8-540dd4d9354e None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.380336 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0358ae-e4b8-40e3-85b8-540dd4d9354e None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.380712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0358ae-e4b8-40e3-85b8-540dd4d9354e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.410183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9d0358ae-e4b8-40e3-85b8-540dd4d9354e None None] MFA Rules not processed for user `9abcaa46fe594b329bc9e18fd2f3086f`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:02.411421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9d0358ae-e4b8-40e3-85b8-540dd4d9354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:02.501288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1329/2671] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:02.508143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0175-435e-4bf1-b892-9bcd404e44f9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.576432 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:02.592011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c0175-435e-4bf1-b892-9bcd404e44f9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.598238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915d1ad-fef6-4137-a87b-bb9aa8e9bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.599148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d1ad-fef6-4137-a87b-bb9aa8e9bab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.599148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d1ad-fef6-4137-a87b-bb9aa8e9bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.599439 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d1ad-fef6-4137-a87b-bb9aa8e9bab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.600173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915d1ad-fef6-4137-a87b-bb9aa8e9bab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.602093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915d1ad-fef6-4137-a87b-bb9aa8e9bab7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.637178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1343/2672] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:02 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:02.641459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0358ae-e4b8-40e3-85b8-540dd4d9354e None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.652767 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0358ae-e4b8-40e3-85b8-540dd4d9354e None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.678772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:02.727215 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13625-62be-4647-b0b3-cdebf506c4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.727829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13625-62be-4647-b0b3-cdebf506c4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.728113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13625-62be-4647-b0b3-cdebf506c4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.728388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13625-62be-4647-b0b3-cdebf506c4e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.729018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13625-62be-4647-b0b3-cdebf506c4e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.730969 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13625-62be-4647-b0b3-cdebf506c4e9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.763209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1330/2673] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:02 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:02.764543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915d1ad-fef6-4137-a87b-bb9aa8e9bab7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.775033 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915d1ad-fef6-4137-a87b-bb9aa8e9bab7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.779932 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6aeb2-3e56-4865-bddd-48551c169918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.780622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6aeb2-3e56-4865-bddd-48551c169918 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.780947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6aeb2-3e56-4865-bddd-48551c169918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.781223 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6aeb2-3e56-4865-bddd-48551c169918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.781897 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6aeb2-3e56-4865-bddd-48551c169918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.784030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6aeb2-3e56-4865-bddd-48551c169918 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.798315 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1344/2674] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:02.800403 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13625-62be-4647-b0b3-cdebf506c4e9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.811063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13625-62be-4647-b0b3-cdebf506c4e9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.816434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e56b1-2c8d-4455-ac2c-c5656b931be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.817173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e56b1-2c8d-4455-ac2c-c5656b931be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.817485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e56b1-2c8d-4455-ac2c-c5656b931be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.817748 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e56b1-2c8d-4455-ac2c-c5656b931be7 admin admin] PATH_INFO: `/v3/projects/be1912a4c24849179eeebff493a60993/users/645eb2fc959444f9b26888b793cfb990/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.835515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e56b1-2c8d-4455-ac2c-c5656b931be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1912a4c24849179eeebff493a60993, user_id=645eb2fc959444f9b26888b793cfb990, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.838490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e56b1-2c8d-4455-ac2c-c5656b931be7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.855197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1331/2675] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:02 2022] PUT /identity/v3/projects/be1912a4c24849179eeebff493a60993/users/645eb2fc959444f9b26888b793cfb990/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:02.860171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6aeb2-3e56-4865-bddd-48551c169918 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.871048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6aeb2-3e56-4865-bddd-48551c169918 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.930520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d39f4-5bff-4f83-8b4c-bf9a0a4199ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.931121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d39f4-5bff-4f83-8b4c-bf9a0a4199ec admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.931401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d39f4-5bff-4f83-8b4c-bf9a0a4199ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.931673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d39f4-5bff-4f83-8b4c-bf9a0a4199ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.932304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d39f4-5bff-4f83-8b4c-bf9a0a4199ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.933875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d39f4-5bff-4f83-8b4c-bf9a0a4199ec admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.944050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1345/2676] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:02.949043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e56b1-2c8d-4455-ac2c-c5656b931be7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:02.960785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e56b1-2c8d-4455-ac2c-c5656b931be7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:02.965272 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:02.965927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.966206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.966520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] PATH_INFO: `/v3/projects/be1912a4c24849179eeebff493a60993/users/645eb2fc959444f9b26888b793cfb990/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:02.968376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1912a4c24849179eeebff493a60993, user_id=645eb2fc959444f9b26888b793cfb990, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:02.971286 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:02.981223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1332/2677] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:02 2022] PUT /identity/v3/projects/be1912a4c24849179eeebff493a60993/users/645eb2fc959444f9b26888b793cfb990/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:02.991985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c567b1-649c-42ce-9143-7e8dc22fa4c4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:02.992273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c567b1-649c-42ce-9143-7e8dc22fa4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:02.992550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c567b1-649c-42ce-9143-7e8dc22fa4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:03.025030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-13c567b1-649c-42ce-9143-7e8dc22fa4c4 None None] MFA Rules not processed for user `645eb2fc959444f9b26888b793cfb990`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:03.026304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-13c567b1-649c-42ce-9143-7e8dc22fa4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:03.096732 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1346/2678] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:03.108913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:03.111348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:03.173191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95443b32-fde3-4943-bea1-5c95b22d5f4d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:03.190234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:03.190875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:03.191155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:03.191428 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:03.201298 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:03.202781 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:03.213622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1333/2679] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:03.329267 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c567b1-649c-42ce-9143-7e8dc22fa4c4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:03.340528 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c567b1-649c-42ce-9143-7e8dc22fa4c4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:03.344637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d733e-9f50-484f-9735-2c3d554dcbac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:03.345270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d733e-9f50-484f-9735-2c3d554dcbac service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:03.345553 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d733e-9f50-484f-9735-2c3d554dcbac service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:03.345822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d733e-9f50-484f-9735-2c3d554dcbac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:03.408870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:03.425717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d733e-9f50-484f-9735-2c3d554dcbac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:03.427179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d733e-9f50-484f-9735-2c3d554dcbac service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:03.437838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1347/2680] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:05.078130 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:05.080302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:05.147887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce224-daca-4b0b-bbc4-db445bc26639 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:05.152685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:05.153324 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:05.153601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:05.153874 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] PATH_INFO: `/v3/users/c587177f739141a4a155db88ea560f4a` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:05.155234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c587177f739141a4a155db88ea560f4a)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:05.157398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:05.183013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:05.214881 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c587177f739141a4a155db88ea560f4a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.222801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c587177f739141a4a155db88ea560f4a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.223497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c587177f739141a4a155db88ea560f4a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.231858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c587177f739141a4a155db88ea560f4a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.245230 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c587177f739141a4a155db88ea560f4a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.251777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1334/2681] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:05 2022] DELETE /identity/v3/users/c587177f739141a4a155db88ea560f4a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:05.258045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1316269-cb37-421f-9d79-bcc155547d89 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:05.258782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1316269-cb37-421f-9d79-bcc155547d89 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:05.258782 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1316269-cb37-421f-9d79-bcc155547d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:05.279810 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c1316269-cb37-421f-9d79-bcc155547d89 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:05.281098 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c1316269-cb37-421f-9d79-bcc155547d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:05.347080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1348/2682] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:05.357752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:05.359620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:05.429933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3f991-171b-4e61-a4d2-70e62bfe7897 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:05.433879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071aed0-42ee-45d1-a94f-836722efcfb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:05.434527 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071aed0-42ee-45d1-a94f-836722efcfb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:05.434805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071aed0-42ee-45d1-a94f-836722efcfb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:05.435079 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071aed0-42ee-45d1-a94f-836722efcfb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:05.448031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071aed0-42ee-45d1-a94f-836722efcfb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:05.451001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071aed0-42ee-45d1-a94f-836722efcfb6 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:05.474491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1335/2683] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:05.787189 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1316269-cb37-421f-9d79-bcc155547d89 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:05.788754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c1316269-cb37-421f-9d79-bcc155547d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:05.801683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1316269-cb37-421f-9d79-bcc155547d89 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:05.807702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:05.808348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:05.808624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:05.809456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] PATH_INFO: `/v3/projects/d444f4b3d94f49e1bd3182d2cca647a9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:05.810950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d444f4b3d94f49e1bd3182d2cca647a9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:05.812896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:05.864595 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd444f4b3d94f49e1bd3182d2cca647a9', 'request_id': 'req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.871082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd444f4b3d94f49e1bd3182d2cca647a9', 'request_id': 'req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.877137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd444f4b3d94f49e1bd3182d2cca647a9', 'request_id': 'req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.888614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] The token cache is being invalidate because project d444f4b3d94f49e1bd3182d2cca647a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:05.888903 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.889533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:05.891074 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1349/2684] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:05 2022] DELETE /identity/v3/projects/d444f4b3d94f49e1bd3182d2cca647a9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:05.895603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071aed0-42ee-45d1-a94f-836722efcfb6 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:05.905713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071aed0-42ee-45d1-a94f-836722efcfb6 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:05.973171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:05.973819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:05.974101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:05.974411 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] PATH_INFO: `/v3/users/5fe49ef827be4002befc8da7c0b15b84` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:05.975676 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe49ef827be4002befc8da7c0b15b84)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:05.977646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:06.029359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:06.032242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe49ef827be4002befc8da7c0b15b84'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.041548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe49ef827be4002befc8da7c0b15b84'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.042496 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe49ef827be4002befc8da7c0b15b84'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.052051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe49ef827be4002befc8da7c0b15b84'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.064356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-38511bb3-f72e-4a36-a532-8d0346166ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe49ef827be4002befc8da7c0b15b84'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.070241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1336/2685] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:05 2022] DELETE /identity/v3/users/5fe49ef827be4002befc8da7c0b15b84 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:06.096690 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:06.098337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:06.112543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe0019-84f6-49bc-9ea1-d312aa45ffed admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:06.177451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:06.178321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:06.178637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:06.179056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] PATH_INFO: `/v3/users/9abcaa46fe594b329bc9e18fd2f3086f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:06.180966 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9abcaa46fe594b329bc9e18fd2f3086f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:06.182974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:06.190321 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:06.243254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9abcaa46fe594b329bc9e18fd2f3086f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.250554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9abcaa46fe594b329bc9e18fd2f3086f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.251310 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9abcaa46fe594b329bc9e18fd2f3086f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.260125 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9abcaa46fe594b329bc9e18fd2f3086f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.260890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9abcaa46fe594b329bc9e18fd2f3086f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.281686 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1350/2686] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:06 2022] DELETE /identity/v3/users/9abcaa46fe594b329bc9e18fd2f3086f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:06.286860 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05ee2f-18ee-4a36-a9d4-27541c4d96f2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:06.287358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05ee2f-18ee-4a36-a9d4-27541c4d96f2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:06.287525 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05ee2f-18ee-4a36-a9d4-27541c4d96f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:06.307793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0a05ee2f-18ee-4a36-a9d4-27541c4d96f2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:06.309171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0a05ee2f-18ee-4a36-a9d4-27541c4d96f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:06.358797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:06.360151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:06.379782 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1337/2687] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:06.390777 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05ee2f-18ee-4a36-a9d4-27541c4d96f2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:06.393055 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0a05ee2f-18ee-4a36-a9d4-27541c4d96f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:06.436431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c28a4-9726-4dcb-bee8-6af991e7903f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:06.441442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:06.442073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:06.442356 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:06.443073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] PATH_INFO: `/v3/projects/f9dd7cdfd6c54b00b4bfbfa33e12101d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:06.443875 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9dd7cdfd6c54b00b4bfbfa33e12101d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:06.445787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:06.457846 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05ee2f-18ee-4a36-a9d4-27541c4d96f2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:06.461530 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa80f-3389-48e8-b399-e2e0b8bc04b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:06.462186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa80f-3389-48e8-b399-e2e0b8bc04b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:06.462499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa80f-3389-48e8-b399-e2e0b8bc04b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:06.462776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752aa80f-3389-48e8-b399-e2e0b8bc04b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:06.474381 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752aa80f-3389-48e8-b399-e2e0b8bc04b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:06.476072 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752aa80f-3389-48e8-b399-e2e0b8bc04b3 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:06.487208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1338/2688] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:29:06.499899 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9dd7cdfd6c54b00b4bfbfa33e12101d', 'request_id': 'req-da8bce41-dc8b-43a7-abb3-61b63dfb58af'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.507041 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9dd7cdfd6c54b00b4bfbfa33e12101d', 'request_id': 'req-da8bce41-dc8b-43a7-abb3-61b63dfb58af'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.516215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9dd7cdfd6c54b00b4bfbfa33e12101d', 'request_id': 'req-da8bce41-dc8b-43a7-abb3-61b63dfb58af'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.532185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] The token cache is being invalidate because project f9dd7cdfd6c54b00b4bfbfa33e12101d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:06.532185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.532185 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.534817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1351/2689] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:06 2022] DELETE /identity/v3/projects/f9dd7cdfd6c54b00b4bfbfa33e12101d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:06.540064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa80f-3389-48e8-b399-e2e0b8bc04b3 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:06.560008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752aa80f-3389-48e8-b399-e2e0b8bc04b3 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:06.672447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:06.682325 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:06.682923 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:06.683335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] PATH_INFO: `/v3/users/ea10e1d62b6e41439dbb80c77e08e77e` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:06.686998 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea10e1d62b6e41439dbb80c77e08e77e)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:06.690121 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:06.696183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:06.746715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea10e1d62b6e41439dbb80c77e08e77e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.762183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea10e1d62b6e41439dbb80c77e08e77e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.762183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea10e1d62b6e41439dbb80c77e08e77e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.765498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea10e1d62b6e41439dbb80c77e08e77e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.778459 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea10e1d62b6e41439dbb80c77e08e77e'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.785122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1339/2690] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:06 2022] DELETE /identity/v3/users/ea10e1d62b6e41439dbb80c77e08e77e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:06.832425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:06.833986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:06.859904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bce41-dc8b-43a7-abb3-61b63dfb58af admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:06.874194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:06.924549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:06.925198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:06.925480 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:06.925760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] PATH_INFO: `/v3/projects/8e2030b73a06484f8e7b867b7b7a2698` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:06.926922 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2030b73a06484f8e7b867b7b7a2698)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:06.928830 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:06.983656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2030b73a06484f8e7b867b7b7a2698', 'request_id': 'req-2c416472-e07e-444d-9496-2040a7d51482'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.991817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2030b73a06484f8e7b867b7b7a2698', 'request_id': 'req-2c416472-e07e-444d-9496-2040a7d51482'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:06.997937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2030b73a06484f8e7b867b7b7a2698', 'request_id': 'req-2c416472-e07e-444d-9496-2040a7d51482'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.012756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] The token cache is being invalidate because project 8e2030b73a06484f8e7b867b7b7a2698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:07.013053 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.013696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.015262 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1352/2691] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:06 2022] DELETE /identity/v3/projects/8e2030b73a06484f8e7b867b7b7a2698 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:07.019961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.021398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.034709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8a12c-6c3f-4170-b56a-20bae12e4e7c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.076833 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.079008 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.120021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.120667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.120957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.121236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] PATH_INFO: `/v3/users/645eb2fc959444f9b26888b793cfb990` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.122522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=645eb2fc959444f9b26888b793cfb990)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.125442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.169592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c416472-e07e-444d-9496-2040a7d51482 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.174738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.175378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.175666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.175946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] PATH_INFO: `/v3/projects/b00db9c8339f43e7b4956df7589dc538` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.177084 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00db9c8339f43e7b4956df7589dc538)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.179022 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.183133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645eb2fc959444f9b26888b793cfb990'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.190828 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645eb2fc959444f9b26888b793cfb990'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.191457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645eb2fc959444f9b26888b793cfb990'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.199728 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645eb2fc959444f9b26888b793cfb990'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.218806 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-80184cd4-b3cb-425a-ac25-e9e8a4f3ee3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645eb2fc959444f9b26888b793cfb990'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.230179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1340/2692] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:07 2022] DELETE /identity/v3/users/645eb2fc959444f9b26888b793cfb990 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:07.230993 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:07.233149 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00db9c8339f43e7b4956df7589dc538', 'request_id': 'req-7ede8a8e-6b55-4936-9118-fc1793dc2914'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.243025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00db9c8339f43e7b4956df7589dc538', 'request_id': 'req-7ede8a8e-6b55-4936-9118-fc1793dc2914'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.249213 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00db9c8339f43e7b4956df7589dc538', 'request_id': 'req-7ede8a8e-6b55-4936-9118-fc1793dc2914'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.263806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] The token cache is being invalidate because project b00db9c8339f43e7b4956df7589dc538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:07.264491 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.265086 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ede8a8e-6b55-4936-9118-fc1793dc2914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.266879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1353/2693] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:07 2022] DELETE /identity/v3/projects/b00db9c8339f43e7b4956df7589dc538 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:07.276829 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a882967-d100-4e7f-8533-8660c16e82e4 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.277113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a882967-d100-4e7f-8533-8660c16e82e4 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.277504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a882967-d100-4e7f-8533-8660c16e82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.286444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:07.299993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9a882967-d100-4e7f-8533-8660c16e82e4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:07.301227 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9a882967-d100-4e7f-8533-8660c16e82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.366928 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1341/2694] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:07.374631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40eb3-8652-4b26-8ba6-9097000f59ab None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.375007 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40eb3-8652-4b26-8ba6-9097000f59ab None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.375362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40eb3-8652-4b26-8ba6-9097000f59ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.400503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dce40eb3-8652-4b26-8ba6-9097000f59ab None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:07.401738 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dce40eb3-8652-4b26-8ba6-9097000f59ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.411700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1354/2695] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:07.416432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a882967-d100-4e7f-8533-8660c16e82e4 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.427108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a882967-d100-4e7f-8533-8660c16e82e4 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.431832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.432473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.432753 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.433029 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] PATH_INFO: `/v3/domains` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.433680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81701) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:29:07.433982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.435608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.449339 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1342/2696] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:29:07.453272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce40eb3-8652-4b26-8ba6-9097000f59ab None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.463659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce40eb3-8652-4b26-8ba6-9097000f59ab None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.469211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.469760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.470093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.471807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.471807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.473627 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.507569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1355/2697] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:07 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:07.508744 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.520236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3dcfd-c8d7-4c5f-986a-eb46df6c477e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.544295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.546218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.593371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691360-0c4a-422d-ac6d-478411fdb1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.593983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691360-0c4a-422d-ac6d-478411fdb1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.594337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691360-0c4a-422d-ac6d-478411fdb1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.594619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691360-0c4a-422d-ac6d-478411fdb1bb admin admin] PATH_INFO: `/v3/users` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.596060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6691360-0c4a-422d-ac6d-478411fdb1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.598011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6691360-0c4a-422d-ac6d-478411fdb1bb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.619775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1343/2698] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:07 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:07.623978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691360-0c4a-422d-ac6d-478411fdb1bb admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.629808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0eb9c-5dd7-46b5-9ab7-994a9c865f8a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.634413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691360-0c4a-422d-ac6d-478411fdb1bb admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.634675 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.635350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.635635 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.635910 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] PATH_INFO: `/v3/projects/be1912a4c24849179eeebff493a60993` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.637064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1912a4c24849179eeebff493a60993)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.639055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.639552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2d84-cd63-425e-a2c9-6950a672b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.640160 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2d84-cd63-425e-a2c9-6950a672b92c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.640443 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2d84-cd63-425e-a2c9-6950a672b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.640784 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2d84-cd63-425e-a2c9-6950a672b92c admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.641363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2d84-cd63-425e-a2c9-6950a672b92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.643520 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2d84-cd63-425e-a2c9-6950a672b92c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.659042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1344/2699] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:29:07.660791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2d84-cd63-425e-a2c9-6950a672b92c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.671907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2d84-cd63-425e-a2c9-6950a672b92c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.677891 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ee2d8-c4d6-450a-92a3-e99c60b63f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.679076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee2d8-c4d6-450a-92a3-e99c60b63f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.679370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee2d8-c4d6-450a-92a3-e99c60b63f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.679658 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ee2d8-c4d6-450a-92a3-e99c60b63f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.680310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ee2d8-c4d6-450a-92a3-e99c60b63f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.681906 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ee2d8-c4d6-450a-92a3-e99c60b63f00 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.699609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1345/2700] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:29:07.700221 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1912a4c24849179eeebff493a60993', 'request_id': 'req-55739d07-b355-4df1-8d6c-b4b9296d4872'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.700993 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ee2d8-c4d6-450a-92a3-e99c60b63f00 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.705988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1912a4c24849179eeebff493a60993', 'request_id': 'req-55739d07-b355-4df1-8d6c-b4b9296d4872'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.715832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ee2d8-c4d6-450a-92a3-e99c60b63f00 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.717232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1912a4c24849179eeebff493a60993', 'request_id': 'req-55739d07-b355-4df1-8d6c-b4b9296d4872'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.743640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] The token cache is being invalidate because project be1912a4c24849179eeebff493a60993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:07.746634 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.747436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55739d07-b355-4df1-8d6c-b4b9296d4872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:07.749331 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1356/2701] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:07 2022] DELETE /identity/v3/projects/be1912a4c24849179eeebff493a60993 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:07.755831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064c80-97dc-49bc-840b-d9dda7148970 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.756192 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064c80-97dc-49bc-840b-d9dda7148970 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.756513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67064c80-97dc-49bc-840b-d9dda7148970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.790653 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:07.800153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-67064c80-97dc-49bc-840b-d9dda7148970 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:07.801640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-67064c80-97dc-49bc-840b-d9dda7148970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.802096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f44ea1-0fce-4208-b491-f2e93d960910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.803004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44ea1-0fce-4208-b491-f2e93d960910 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.803609 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44ea1-0fce-4208-b491-f2e93d960910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.804060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f44ea1-0fce-4208-b491-f2e93d960910 admin admin] PATH_INFO: `/v3/projects/ecafddb90a30499ab0464807cc941965/users/dc0918a327424d549be57b0e581bd649/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.811914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1357/2702] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:07.821479 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94db4-ab7c-471b-9df6-e4e14898f057 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.821771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94db4-ab7c-471b-9df6-e4e14898f057 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.822707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94db4-ab7c-471b-9df6-e4e14898f057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.824085 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f44ea1-0fce-4208-b491-f2e93d960910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecafddb90a30499ab0464807cc941965, user_id=dc0918a327424d549be57b0e581bd649, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.826953 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f44ea1-0fce-4208-b491-f2e93d960910 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.844446 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ffe94db4-ab7c-471b-9df6-e4e14898f057 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:07.845596 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1346/2703] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:07 2022] PUT /identity/v3/projects/ecafddb90a30499ab0464807cc941965/users/dc0918a327424d549be57b0e581bd649/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:07.845737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ffe94db4-ab7c-471b-9df6-e4e14898f057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.855952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43847-06b9-4785-af7c-c1f0b9d474c5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.856338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43847-06b9-4785-af7c-c1f0b9d474c5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.856621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43847-06b9-4785-af7c-c1f0b9d474c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.884454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:07.894165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-c1f43847-06b9-4785-af7c-c1f0b9d474c5 None None] MFA Rules not processed for user `dc0918a327424d549be57b0e581bd649`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:07.895729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c1f43847-06b9-4785-af7c-c1f0b9d474c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.927926 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1358/2704] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:07.932563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe94db4-ab7c-471b-9df6-e4e14898f057 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.941433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe94db4-ab7c-471b-9df6-e4e14898f057 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.946265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.946895 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.947178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.947462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.948299 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:29:07.948445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.950355 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:07.966216 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1359/2705] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:29:07.967236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.973511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1347/2706] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:07.979108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4228ed9-84dc-4497-9ae8-e4c4d8666d2c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:07.983504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816d05-6929-4dee-beaf-f5aed6b43736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:07.983890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f43847-06b9-4785-af7c-c1f0b9d474c5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:07.984139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816d05-6929-4dee-beaf-f5aed6b43736 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:07.984423 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816d05-6929-4dee-beaf-f5aed6b43736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:07.984700 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816d05-6929-4dee-beaf-f5aed6b43736 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:07.985291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c1f43847-06b9-4785-af7c-c1f0b9d474c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:07.985407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65816d05-6929-4dee-beaf-f5aed6b43736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:07.988045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65816d05-6929-4dee-beaf-f5aed6b43736 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.019594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1360/2707] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:07 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:29:08.020988 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816d05-6929-4dee-beaf-f5aed6b43736 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.046297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f43847-06b9-4785-af7c-c1f0b9d474c5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.084631 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816d05-6929-4dee-beaf-f5aed6b43736 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.089868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8fb9-8176-4c0b-967d-90f671fa5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.090514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8fb9-8176-4c0b-967d-90f671fa5e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.090796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8fb9-8176-4c0b-967d-90f671fa5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.091069 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8fb9-8176-4c0b-967d-90f671fa5e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.091698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8fb9-8176-4c0b-967d-90f671fa5e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.093609 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8fb9-8176-4c0b-967d-90f671fa5e98 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.097326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1238-de64-45f0-8c32-2b1049b3d24a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.097952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1238-de64-45f0-8c32-2b1049b3d24a service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.098239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1238-de64-45f0-8c32-2b1049b3d24a service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.098546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1238-de64-45f0-8c32-2b1049b3d24a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.117379 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1361/2708] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:08 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:29:08.121496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8fb9-8176-4c0b-967d-90f671fa5e98 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.132330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8fb9-8176-4c0b-967d-90f671fa5e98 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.136956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ca570-672d-4f82-b662-62b533c8cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.137676 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca570-672d-4f82-b662-62b533c8cadc admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.137961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca570-672d-4f82-b662-62b533c8cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.138237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ca570-672d-4f82-b662-62b533c8cadc admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.138906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ca570-672d-4f82-b662-62b533c8cadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.140497 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ca570-672d-4f82-b662-62b533c8cadc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.141601 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:08.154691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1362/2709] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:08.155957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ca570-672d-4f82-b662-62b533c8cadc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.159460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb1238-de64-45f0-8c32-2b1049b3d24a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.160895 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb1238-de64-45f0-8c32-2b1049b3d24a service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.166643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ca570-672d-4f82-b662-62b533c8cadc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.169841 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1348/2710] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:29:08.171854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7733ca-8cd6-4ba1-9efe-e2fecb7f3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.172459 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7733ca-8cd6-4ba1-9efe-e2fecb7f3eec admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.172737 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7733ca-8cd6-4ba1-9efe-e2fecb7f3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.173036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7733ca-8cd6-4ba1-9efe-e2fecb7f3eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.173965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7733ca-8cd6-4ba1-9efe-e2fecb7f3eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.175808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7733ca-8cd6-4ba1-9efe-e2fecb7f3eec admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.191100 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1363/2711] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:29:08.192866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1238-de64-45f0-8c32-2b1049b3d24a service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.203727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1238-de64-45f0-8c32-2b1049b3d24a service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.209677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635aaded-2f82-4c5b-b084-21c4bf28115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.210369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aaded-2f82-4c5b-b084-21c4bf28115f admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.210655 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aaded-2f82-4c5b-b084-21c4bf28115f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.210936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aaded-2f82-4c5b-b084-21c4bf28115f admin admin] PATH_INFO: `/v3/projects/9330f52e682c47c0ad1f77cd6a9c0e3c/users/e21216d97cb7494cbc2822daebd1f779/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.227514 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635aaded-2f82-4c5b-b084-21c4bf28115f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9330f52e682c47c0ad1f77cd6a9c0e3c, user_id=e21216d97cb7494cbc2822daebd1f779, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.230220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635aaded-2f82-4c5b-b084-21c4bf28115f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.247984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1349/2712] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:08 2022] PUT /identity/v3/projects/9330f52e682c47c0ad1f77cd6a9c0e3c/users/e21216d97cb7494cbc2822daebd1f779/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:08.260116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb147cc0-2b8e-49d2-882a-664ffad4645b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.260226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb147cc0-2b8e-49d2-882a-664ffad4645b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.260529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb147cc0-2b8e-49d2-882a-664ffad4645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.291805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-eb147cc0-2b8e-49d2-882a-664ffad4645b None None] MFA Rules not processed for user `e21216d97cb7494cbc2822daebd1f779`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:08.293039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eb147cc0-2b8e-49d2-882a-664ffad4645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:08.353952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:08.367579 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1364/2713] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:08.372356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635aaded-2f82-4c5b-b084-21c4bf28115f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.463163 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635aaded-2f82-4c5b-b084-21c4bf28115f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.467849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278423aa-10d7-4377-ab17-df75e1b232e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.468447 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278423aa-10d7-4377-ab17-df75e1b232e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.468731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278423aa-10d7-4377-ab17-df75e1b232e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.469006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278423aa-10d7-4377-ab17-df75e1b232e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.469683 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278423aa-10d7-4377-ab17-df75e1b232e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.472057 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278423aa-10d7-4377-ab17-df75e1b232e9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.505775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1350/2714] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:08 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:08.507068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb147cc0-2b8e-49d2-882a-664ffad4645b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.520705 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb147cc0-2b8e-49d2-882a-664ffad4645b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.599157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b428a9-8597-4e22-82e6-7bf52bbf6b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.599808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b428a9-8597-4e22-82e6-7bf52bbf6b94 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.600001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b428a9-8597-4e22-82e6-7bf52bbf6b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.600276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b428a9-8597-4e22-82e6-7bf52bbf6b94 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.600912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b428a9-8597-4e22-82e6-7bf52bbf6b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.602860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b428a9-8597-4e22-82e6-7bf52bbf6b94 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.625433 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1365/2715] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:08 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:08.629623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278423aa-10d7-4377-ab17-df75e1b232e9 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.641228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278423aa-10d7-4377-ab17-df75e1b232e9 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.646840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db840-5b37-42f4-ae23-19607b63d41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.647458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db840-5b37-42f4-ae23-19607b63d41f admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.647734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db840-5b37-42f4-ae23-19607b63d41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.648011 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db840-5b37-42f4-ae23-19607b63d41f admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.648652 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740db840-5b37-42f4-ae23-19607b63d41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.650252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740db840-5b37-42f4-ae23-19607b63d41f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.662287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1351/2716] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:08.666837 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b428a9-8597-4e22-82e6-7bf52bbf6b94 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.683625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b428a9-8597-4e22-82e6-7bf52bbf6b94 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.688698 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af7adb-ef44-4af0-9ea7-bdb569be627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.690016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af7adb-ef44-4af0-9ea7-bdb569be627a admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.690336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af7adb-ef44-4af0-9ea7-bdb569be627a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.690619 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af7adb-ef44-4af0-9ea7-bdb569be627a admin admin] PATH_INFO: `/v3/projects/28592beb8a8d440b9b85a93e0c63d12f/users/caa040136981402097fac67ce6ca8061/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.708808 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af7adb-ef44-4af0-9ea7-bdb569be627a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28592beb8a8d440b9b85a93e0c63d12f, user_id=caa040136981402097fac67ce6ca8061, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.712111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af7adb-ef44-4af0-9ea7-bdb569be627a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.728947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1366/2717] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:08 2022] PUT /identity/v3/projects/28592beb8a8d440b9b85a93e0c63d12f/users/caa040136981402097fac67ce6ca8061/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:08.734462 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db840-5b37-42f4-ae23-19607b63d41f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.745191 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db840-5b37-42f4-ae23-19607b63d41f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.804700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc1248-86ac-4993-85bc-7880f5190202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.805310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1248-86ac-4993-85bc-7880f5190202 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.805593 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1248-86ac-4993-85bc-7880f5190202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.805869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc1248-86ac-4993-85bc-7880f5190202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.806556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1248-86ac-4993-85bc-7880f5190202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.808150 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc1248-86ac-4993-85bc-7880f5190202 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.823664 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1352/2718] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:08.825473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af7adb-ef44-4af0-9ea7-bdb569be627a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:08.838608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af7adb-ef44-4af0-9ea7-bdb569be627a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:08.843325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:08.843992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.844272 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.844545 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] PATH_INFO: `/v3/projects/28592beb8a8d440b9b85a93e0c63d12f/users/caa040136981402097fac67ce6ca8061/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.846944 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28592beb8a8d440b9b85a93e0c63d12f, user_id=caa040136981402097fac67ce6ca8061, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:08.849679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:08.861720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1367/2719] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:08 2022] PUT /identity/v3/projects/28592beb8a8d440b9b85a93e0c63d12f/users/caa040136981402097fac67ce6ca8061/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:08.873069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa038-7559-4adb-b357-f94d38db6cae None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:08.873382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa038-7559-4adb-b357-f94d38db6cae None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:08.873644 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa038-7559-4adb-b357-f94d38db6cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:08.906811 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-5f6aa038-7559-4adb-b357-f94d38db6cae None None] MFA Rules not processed for user `caa040136981402097fac67ce6ca8061`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:08.908331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5f6aa038-7559-4adb-b357-f94d38db6cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:08.924132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:08.993742 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1353/2720] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:09.006693 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:09.008322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:09.080706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98572a65-a9c8-44f5-aa99-93dcc994fc49 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:09.084942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c5852-82a7-4aba-8343-ae799fed490f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:09.085551 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c5852-82a7-4aba-8343-ae799fed490f service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:09.085824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c5852-82a7-4aba-8343-ae799fed490f service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:09.086096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c5852-82a7-4aba-8343-ae799fed490f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:09.096052 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c5852-82a7-4aba-8343-ae799fed490f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:09.097481 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c5852-82a7-4aba-8343-ae799fed490f service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:09.107364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1368/2721] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:09.195378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aa038-7559-4adb-b357-f94d38db6cae None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:09.205921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aa038-7559-4adb-b357-f94d38db6cae None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:09.210564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ccf06-45c4-4ef5-9b3f-50d3ff9a3bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:09.211271 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ccf06-45c4-4ef5-9b3f-50d3ff9a3bfc service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:09.211553 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ccf06-45c4-4ef5-9b3f-50d3ff9a3bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:09.211830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ccf06-45c4-4ef5-9b3f-50d3ff9a3bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:09.273404 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ccf06-45c4-4ef5-9b3f-50d3ff9a3bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:09.274809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ccf06-45c4-4ef5-9b3f-50d3ff9a3bfc service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:09.285705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1354/2722] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:14.315541 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c5852-82a7-4aba-8343-ae799fed490f service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:14.376050 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:14.393759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c5852-82a7-4aba-8343-ae799fed490f service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:14.398476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:14.399190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.399540 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.399887 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] PATH_INFO: `/v3/users/e21216d97cb7494cbc2822daebd1f779` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.401114 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21216d97cb7494cbc2822daebd1f779)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:14.404839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:14.478030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21216d97cb7494cbc2822daebd1f779'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.487412 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21216d97cb7494cbc2822daebd1f779'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.488179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21216d97cb7494cbc2822daebd1f779'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.505581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21216d97cb7494cbc2822daebd1f779'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.510314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21216d97cb7494cbc2822daebd1f779'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.537914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1369/2723] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:14 2022] DELETE /identity/v3/users/e21216d97cb7494cbc2822daebd1f779 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:14.545270 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c362-ec32-4c1c-9f14-de67dc850f72 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.545797 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c362-ec32-4c1c-9f14-de67dc850f72 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.546226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c362-ec32-4c1c-9f14-de67dc850f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.581538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-99e3c362-ec32-4c1c-9f14-de67dc850f72 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:14.584032 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-99e3c362-ec32-4c1c-9f14-de67dc850f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:14.684838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1355/2724] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:14.690515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:14.692706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:14.763806 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0efc7-94e0-4c36-9961-8c54f588cc30 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:14.768128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c316ccc-2210-46e8-a92c-c744968aeba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:14.768999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c316ccc-2210-46e8-a92c-c744968aeba3 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.769294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c316ccc-2210-46e8-a92c-c744968aeba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.769572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c316ccc-2210-46e8-a92c-c744968aeba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.779744 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c316ccc-2210-46e8-a92c-c744968aeba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:14.781179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c316ccc-2210-46e8-a92c-c744968aeba3 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:14.792048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1370/2725] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:15.139732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3c362-ec32-4c1c-9f14-de67dc850f72 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:15.141424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-99e3c362-ec32-4c1c-9f14-de67dc850f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:15.157455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3c362-ec32-4c1c-9f14-de67dc850f72 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:15.163703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:15.164556 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.164933 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.165301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] PATH_INFO: `/v3/projects/9330f52e682c47c0ad1f77cd6a9c0e3c` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.166610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9330f52e682c47c0ad1f77cd6a9c0e3c)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:15.169069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:15.224284 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:15.230509 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9330f52e682c47c0ad1f77cd6a9c0e3c', 'request_id': 'req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.239083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9330f52e682c47c0ad1f77cd6a9c0e3c', 'request_id': 'req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.248967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9330f52e682c47c0ad1f77cd6a9c0e3c', 'request_id': 'req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.261006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] The token cache is being invalidate because project 9330f52e682c47c0ad1f77cd6a9c0e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:15.261295 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.262097 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.263875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1356/2726] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:15 2022] DELETE /identity/v3/projects/9330f52e682c47c0ad1f77cd6a9c0e3c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:15.268717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c316ccc-2210-46e8-a92c-c744968aeba3 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:15.278403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c316ccc-2210-46e8-a92c-c744968aeba3 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:15.340896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:15.341671 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.341953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.342227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] PATH_INFO: `/v3/users/caa040136981402097fac67ce6ca8061` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.343431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa040136981402097fac67ce6ca8061)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:15.346532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:15.361354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:15.410610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa040136981402097fac67ce6ca8061'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.417768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa040136981402097fac67ce6ca8061'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.418515 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa040136981402097fac67ce6ca8061'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.427667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa040136981402097fac67ce6ca8061'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.428302 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf43e3a5-c967-483e-b9c1-f5c5bf621f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa040136981402097fac67ce6ca8061'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.449904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1371/2727] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:15 2022] DELETE /identity/v3/users/caa040136981402097fac67ce6ca8061 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:15.816348 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:15.817832 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:15.834692 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaa33f-aaf6-44a7-a43f-3ee47fc994ed admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:15.898396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:15.898955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.899233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.899503 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] PATH_INFO: `/v3/projects/28592beb8a8d440b9b85a93e0c63d12f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.900642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28592beb8a8d440b9b85a93e0c63d12f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:15.902762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:15.956837 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28592beb8a8d440b9b85a93e0c63d12f', 'request_id': 'req-2c099c4a-4bea-48c0-be10-2252c9201381'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.963188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28592beb8a8d440b9b85a93e0c63d12f', 'request_id': 'req-2c099c4a-4bea-48c0-be10-2252c9201381'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.972101 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28592beb8a8d440b9b85a93e0c63d12f', 'request_id': 'req-2c099c4a-4bea-48c0-be10-2252c9201381'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.986125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] The token cache is being invalidate because project 28592beb8a8d440b9b85a93e0c63d12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:15.986498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.987214 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-2c099c4a-4bea-48c0-be10-2252c9201381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:15.988833 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1357/2728] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:15 2022] DELETE /identity/v3/projects/28592beb8a8d440b9b85a93e0c63d12f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:15.993964 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8c62-d8d3-4fe3-9a05-22c83672505d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.994253 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8c62-d8d3-4fe3-9a05-22c83672505d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.994577 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8c62-d8d3-4fe3-9a05-22c83672505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.015807 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ff2d8c62-d8d3-4fe3-9a05-22c83672505d None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:16.016758 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ff2d8c62-d8d3-4fe3-9a05-22c83672505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:16.089971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1372/2729] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:16.099116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a6cfc-57c7-487b-8557-321d56b9a3a9 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.099413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a6cfc-57c7-487b-8557-321d56b9a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.099723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a6cfc-57c7-487b-8557-321d56b9a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.121257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-a73a6cfc-57c7-487b-8557-321d56b9a3a9 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:16.122539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-a73a6cfc-57c7-487b-8557-321d56b9a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:16.131842 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1358/2730] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:16.135724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d8c62-d8d3-4fe3-9a05-22c83672505d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:16.149824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d8c62-d8d3-4fe3-9a05-22c83672505d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:16.154797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:16.155443 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.155717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.155994 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.156672 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:29:16.156979 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:16.159329 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:16.172869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1373/2731] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:29:16.177603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a6cfc-57c7-487b-8557-321d56b9a3a9 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:16.187743 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a6cfc-57c7-487b-8557-321d56b9a3a9 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:16.193395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570cf5-4256-4f62-8150-09c445e09b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:16.194109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570cf5-4256-4f62-8150-09c445e09b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.194427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570cf5-4256-4f62-8150-09c445e09b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.194703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570cf5-4256-4f62-8150-09c445e09b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.195375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2570cf5-4256-4f62-8150-09c445e09b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:16.197354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2570cf5-4256-4f62-8150-09c445e09b8f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:16.233838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1359/2732] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:16 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:16.235116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:16.245564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a660da-8519-421d-8fb0-78d39cad7616 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:16.340992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75839fac-115d-4aea-8201-7cff39f3b2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:16.341891 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839fac-115d-4aea-8201-7cff39f3b2eb admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.341998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839fac-115d-4aea-8201-7cff39f3b2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.342234 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839fac-115d-4aea-8201-7cff39f3b2eb admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.342916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75839fac-115d-4aea-8201-7cff39f3b2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:16.345461 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75839fac-115d-4aea-8201-7cff39f3b2eb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:16.373548 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1374/2733] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:16 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:16.378569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570cf5-4256-4f62-8150-09c445e09b8f admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:16.389807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570cf5-4256-4f62-8150-09c445e09b8f admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:16.395356 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe0820-5c65-4505-a3fd-91bf16eb7dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:16.396132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0820-5c65-4505-a3fd-91bf16eb7dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.396482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0820-5c65-4505-a3fd-91bf16eb7dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.396853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0820-5c65-4505-a3fd-91bf16eb7dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.397519 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe0820-5c65-4505-a3fd-91bf16eb7dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:16.399166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe0820-5c65-4505-a3fd-91bf16eb7dc8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:16.412633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1360/2734] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:16.417911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75839fac-115d-4aea-8201-7cff39f3b2eb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:16.429249 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75839fac-115d-4aea-8201-7cff39f3b2eb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:16.434048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e71770-e8ab-4c5c-95e2-0ad99d1700b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:16.434703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71770-e8ab-4c5c-95e2-0ad99d1700b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.434986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71770-e8ab-4c5c-95e2-0ad99d1700b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.435263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e71770-e8ab-4c5c-95e2-0ad99d1700b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.435919 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e71770-e8ab-4c5c-95e2-0ad99d1700b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:16.437655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e71770-e8ab-4c5c-95e2-0ad99d1700b2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:16.439354 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:16.452079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1375/2735] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:16.455715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe0820-5c65-4505-a3fd-91bf16eb7dc8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:16.466847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe0820-5c65-4505-a3fd-91bf16eb7dc8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:16.472780 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:16.473563 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.474395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.474395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] PATH_INFO: `/v3/projects/6a2f016f159b45ed95c02ee19cea6ed6/users/273871988d6041f38c16152acf4d9094/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.491957 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2f016f159b45ed95c02ee19cea6ed6, user_id=273871988d6041f38c16152acf4d9094, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:16.494702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:16.505934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:16.511934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1361/2736] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:16 2022] PUT /identity/v3/projects/6a2f016f159b45ed95c02ee19cea6ed6/users/273871988d6041f38c16152acf4d9094/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:16.522858 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7563-f304-4f18-bbff-9a436480bba4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.523184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7563-f304-4f18-bbff-9a436480bba4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.523460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7563-f304-4f18-bbff-9a436480bba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.558239 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1dba7563-f304-4f18-bbff-9a436480bba4 None None] MFA Rules not processed for user `273871988d6041f38c16152acf4d9094`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:16.559664 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1dba7563-f304-4f18-bbff-9a436480bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:16.665831 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1376/2737] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:16.680583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:16.683232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:16.770795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9113a-bd8a-4086-abde-e09cbacd1cd3 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:16.774791 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b2e9-e7ed-48ff-bc4f-649dd05e6bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:16.775328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b2e9-e7ed-48ff-bc4f-649dd05e6bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:16.775605 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b2e9-e7ed-48ff-bc4f-649dd05e6bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:16.775887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b2e9-e7ed-48ff-bc4f-649dd05e6bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:16.787159 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9b2e9-e7ed-48ff-bc4f-649dd05e6bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:16.788622 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9b2e9-e7ed-48ff-bc4f-649dd05e6bc8 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:16.799680 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1362/2738] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:18.604127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7563-f304-4f18-bbff-9a436480bba4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:18.606484 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1dba7563-f304-4f18-bbff-9a436480bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:18.721982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7563-f304-4f18-bbff-9a436480bba4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:18.727610 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:18.728638 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:18.729099 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:18.729570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] PATH_INFO: `/v3/users/dc0918a327424d549be57b0e581bd649` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:18.731431 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0918a327424d549be57b0e581bd649)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:18.734972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:18.807702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0918a327424d549be57b0e581bd649'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:18.821016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0918a327424d549be57b0e581bd649'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:18.821896 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0918a327424d549be57b0e581bd649'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:18.836440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0918a327424d549be57b0e581bd649'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:18.837305 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0918a327424d549be57b0e581bd649'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:18.867397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1377/2739] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:18 2022] DELETE /identity/v3/users/dc0918a327424d549be57b0e581bd649 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:18.871861 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ef6fb-6339-42a4-a5d6-9758bc215644 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:18.872632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ef6fb-6339-42a4-a5d6-9758bc215644 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:18.873002 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ef6fb-6339-42a4-a5d6-9758bc215644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:18.907012 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6e3ef6fb-6339-42a4-a5d6-9758bc215644 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:18.910602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6e3ef6fb-6339-42a4-a5d6-9758bc215644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:19.033331 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1363/2740] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:19.044771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:19.047418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:19.058983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:19.194246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d57e5-77ab-46a2-b915-01415151df58 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:19.201957 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c725d4d-4a80-4107-9889-b77c44464392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:19.202991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725d4d-4a80-4107-9889-b77c44464392 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:19.203411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725d4d-4a80-4107-9889-b77c44464392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:19.203841 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725d4d-4a80-4107-9889-b77c44464392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:19.222295 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c725d4d-4a80-4107-9889-b77c44464392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:19.224485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c725d4d-4a80-4107-9889-b77c44464392 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:19.242949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1378/2741] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:19.595243 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ef6fb-6339-42a4-a5d6-9758bc215644 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:19.596790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6e3ef6fb-6339-42a4-a5d6-9758bc215644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:19.611014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ef6fb-6339-42a4-a5d6-9758bc215644 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:19.616567 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:19.617223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:19.617499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:19.617936 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] PATH_INFO: `/v3/projects/ecafddb90a30499ab0464807cc941965` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:19.619227 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecafddb90a30499ab0464807cc941965)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:19.621189 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:19.676096 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecafddb90a30499ab0464807cc941965', 'request_id': 'req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:19.685212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecafddb90a30499ab0464807cc941965', 'request_id': 'req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:19.701719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecafddb90a30499ab0464807cc941965', 'request_id': 'req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:19.717293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] The token cache is being invalidate because project ecafddb90a30499ab0464807cc941965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:19.717613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:19.718245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-4a988000-7b4c-4ca1-bacb-4dfcb676fc2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:19.719792 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1364/2742] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:19 2022] DELETE /identity/v3/projects/ecafddb90a30499ab0464807cc941965 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:19.725751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1634f7-4d1c-4afa-8c2b-a84b03b3f2b6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:19.726668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1634f7-4d1c-4afa-8c2b-a84b03b3f2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:19.726668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1634f7-4d1c-4afa-8c2b-a84b03b3f2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:19.748556 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7f1634f7-4d1c-4afa-8c2b-a84b03b3f2b6 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:19.749793 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f1634f7-4d1c-4afa-8c2b-a84b03b3f2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:19.818245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1379/2743] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:19.826124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ce10-5275-4738-a9af-0b9c3a6ecc05 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:19.826441 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ce10-5275-4738-a9af-0b9c3a6ecc05 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:19.826725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ce10-5275-4738-a9af-0b9c3a6ecc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:19.849360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d2a7ce10-5275-4738-a9af-0b9c3a6ecc05 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:19.850795 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d2a7ce10-5275-4738-a9af-0b9c3a6ecc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:19.859051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1365/2744] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:19.864326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1634f7-4d1c-4afa-8c2b-a84b03b3f2b6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:19.874122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1634f7-4d1c-4afa-8c2b-a84b03b3f2b6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:19.879337 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:19.879954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:19.880231 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:19.880504 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:19.881151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:29:19.881463 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:19.883154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:19.900947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1380/2745] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:29:19.902274 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7ce10-5275-4738-a9af-0b9c3a6ecc05 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:19.913014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7ce10-5275-4738-a9af-0b9c3a6ecc05 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:19.917979 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:19.918646 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:19.918927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:19.919211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:19.919866 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:19.921838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:19.946619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:19.958365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1366/2746] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:19 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:29:19.962798 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:19.974440 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9428ff7-8f4e-4912-91c9-00dc5a5854fd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.041361 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e42f50-889d-443b-a347-c51e7f9aa0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.042015 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42f50-889d-443b-a347-c51e7f9aa0ac admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.042421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42f50-889d-443b-a347-c51e7f9aa0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.042697 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42f50-889d-443b-a347-c51e7f9aa0ac admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.043646 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e42f50-889d-443b-a347-c51e7f9aa0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.046180 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e42f50-889d-443b-a347-c51e7f9aa0ac admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.076851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1381/2747] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:19 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:29:20.080041 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.082645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e42f50-889d-443b-a347-c51e7f9aa0ac admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.083029 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:20.093214 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e42f50-889d-443b-a347-c51e7f9aa0ac admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.106767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423fde8-b690-44e8-8a61-0f8fd669c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.107532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a23e-6080-4cbb-821a-a1300ea8ee13 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.108128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423fde8-b690-44e8-8a61-0f8fd669c573 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.108475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423fde8-b690-44e8-8a61-0f8fd669c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.108998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423fde8-b690-44e8-8a61-0f8fd669c573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.110073 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423fde8-b690-44e8-8a61-0f8fd669c573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.113338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423fde8-b690-44e8-8a61-0f8fd669c573 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.114395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.115752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.115752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.115752 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] PATH_INFO: `/v3/users/273871988d6041f38c16152acf4d9094` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.117076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=273871988d6041f38c16152acf4d9094)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.119176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.130781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1382/2748] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:20.136410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423fde8-b690-44e8-8a61-0f8fd669c573 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.154914 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423fde8-b690-44e8-8a61-0f8fd669c573 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.163916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d62d9c-2bab-4ee1-a4da-588722f16645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.164968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62d9c-2bab-4ee1-a4da-588722f16645 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.165472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62d9c-2bab-4ee1-a4da-588722f16645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.166039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62d9c-2bab-4ee1-a4da-588722f16645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.167425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d62d9c-2bab-4ee1-a4da-588722f16645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.171085 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d62d9c-2bab-4ee1-a4da-588722f16645 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.195819 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1383/2749] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:29:20.198906 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d62d9c-2bab-4ee1-a4da-588722f16645 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.209337 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273871988d6041f38c16152acf4d9094'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:20.213925 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:20.225597 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273871988d6041f38c16152acf4d9094'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:20.226932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273871988d6041f38c16152acf4d9094'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:20.227476 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d62d9c-2bab-4ee1-a4da-588722f16645 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.239608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af80cf-cfb9-4d02-b051-881dcda67952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.240265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af80cf-cfb9-4d02-b051-881dcda67952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.240853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af80cf-cfb9-4d02-b051-881dcda67952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.241620 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af80cf-cfb9-4d02-b051-881dcda67952 admin admin] PATH_INFO: `/v3/projects/5d7a479aae1144f289a9c79417c064b4/users/6f56c04652d4406a8af97bd4b0268bc6/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.253369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273871988d6041f38c16152acf4d9094'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:20.270206 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-6c3d10ca-bf0c-49d7-9ec7-72095a8ed9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273871988d6041f38c16152acf4d9094'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:20.277835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1367/2750] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:20 2022] DELETE /identity/v3/users/273871988d6041f38c16152acf4d9094 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:20.280952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af80cf-cfb9-4d02-b051-881dcda67952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a479aae1144f289a9c79417c064b4, user_id=6f56c04652d4406a8af97bd4b0268bc6, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.282049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af80cf-cfb9-4d02-b051-881dcda67952 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.284014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724b522-1b58-4628-bf38-4c04523f90e2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.284504 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724b522-1b58-4628-bf38-4c04523f90e2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.284973 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724b522-1b58-4628-bf38-4c04523f90e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.305790 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1384/2751] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:20 2022] PUT /identity/v3/projects/5d7a479aae1144f289a9c79417c064b4/users/6f56c04652d4406a8af97bd4b0268bc6/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:20.314330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f3817-704e-4646-9853-fa11a0f263a7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.314821 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f3817-704e-4646-9853-fa11a0f263a7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.315260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f3817-704e-4646-9853-fa11a0f263a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.322138 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-2724b522-1b58-4628-bf38-4c04523f90e2 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:20.324392 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2724b522-1b58-4628-bf38-4c04523f90e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:20.352969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e29f3817-704e-4646-9853-fa11a0f263a7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:20.355183 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e29f3817-704e-4646-9853-fa11a0f263a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:20.422021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1368/2752] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:20.432927 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724b522-1b58-4628-bf38-4c04523f90e2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.434538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2724b522-1b58-4628-bf38-4c04523f90e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:20.444767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1385/2753] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:20.455206 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f3817-704e-4646-9853-fa11a0f263a7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.457017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e29f3817-704e-4646-9853-fa11a0f263a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:20.514641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724b522-1b58-4628-bf38-4c04523f90e2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.519242 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.519879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.520165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.520437 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.530351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f3817-704e-4646-9853-fa11a0f263a7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.533330 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.534851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.536558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7c4b5-d982-45f5-83e5-e22fcfdbcb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.537421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c4b5-d982-45f5-83e5-e22fcfdbcb04 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.537874 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c4b5-d982-45f5-83e5-e22fcfdbcb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.538307 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c4b5-d982-45f5-83e5-e22fcfdbcb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.545252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1369/2754] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:29:20.553131 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7c4b5-d982-45f5-83e5-e22fcfdbcb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.554745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7c4b5-d982-45f5-83e5-e22fcfdbcb04 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.567254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1386/2755] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:29:20.916302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.918239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:20.932572 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ac3db-fcc7-48bd-babf-a1230b5fd28f service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.937551 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.939166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.939715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.940205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] PATH_INFO: `/v3/projects/6a2f016f159b45ed95c02ee19cea6ed6` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.942161 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2f016f159b45ed95c02ee19cea6ed6)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.944408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.956100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:21.014018 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2f016f159b45ed95c02ee19cea6ed6', 'request_id': 'req-8cf962b8-4849-475d-99b6-1e87f90d2298'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:21.023021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2f016f159b45ed95c02ee19cea6ed6', 'request_id': 'req-8cf962b8-4849-475d-99b6-1e87f90d2298'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:21.035426 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2f016f159b45ed95c02ee19cea6ed6', 'request_id': 'req-8cf962b8-4849-475d-99b6-1e87f90d2298'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:21.049125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] The token cache is being invalidate because project 6a2f016f159b45ed95c02ee19cea6ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:21.049485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:21.050119 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8cf962b8-4849-475d-99b6-1e87f90d2298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:21.051924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1370/2756] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:20 2022] DELETE /identity/v3/projects/6a2f016f159b45ed95c02ee19cea6ed6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:21.058630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c6cc-d3eb-4166-a1e3-7b340f413f91 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.059117 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c6cc-d3eb-4166-a1e3-7b340f413f91 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.059726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c6cc-d3eb-4166-a1e3-7b340f413f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.090229 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5526c6cc-d3eb-4166-a1e3-7b340f413f91 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:21.091965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5526c6cc-d3eb-4166-a1e3-7b340f413f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:21.206989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1387/2757] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:21.208925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e1836-5420-42bc-a6bc-2e0bc38f5753 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.209209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e1836-5420-42bc-a6bc-2e0bc38f5753 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.209485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e1836-5420-42bc-a6bc-2e0bc38f5753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.230457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-036e1836-5420-42bc-a6bc-2e0bc38f5753 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:21.231702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-036e1836-5420-42bc-a6bc-2e0bc38f5753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:21.242880 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1371/2758] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:21.246108 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c6cc-d3eb-4166-a1e3-7b340f413f91 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:21.257585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c6cc-d3eb-4166-a1e3-7b340f413f91 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:21.262394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:21.263152 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.263436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.263707 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.264365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:29:21.264669 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:21.266292 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:21.280864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1388/2759] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:29:21.285787 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e1836-5420-42bc-a6bc-2e0bc38f5753 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:21.299817 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e1836-5420-42bc-a6bc-2e0bc38f5753 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:21.307301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58516144-2a9a-4eb0-b5a1-e7908ceeab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:21.308195 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516144-2a9a-4eb0-b5a1-e7908ceeab9c admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.308719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516144-2a9a-4eb0-b5a1-e7908ceeab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.309074 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58516144-2a9a-4eb0-b5a1-e7908ceeab9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.309813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58516144-2a9a-4eb0-b5a1-e7908ceeab9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:21.312733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58516144-2a9a-4eb0-b5a1-e7908ceeab9c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:21.366477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1372/2760] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:21 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:29:21.372207 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:21.388372 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863974cf-a14c-4168-a770-8e121133a2b3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:21.397151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:21.488330 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bca0e-bca4-4539-8a62-6e5dd7e62550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:21.489194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bca0e-bca4-4539-8a62-6e5dd7e62550 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.489876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bca0e-bca4-4539-8a62-6e5dd7e62550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.490304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bca0e-bca4-4539-8a62-6e5dd7e62550 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.491065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bca0e-bca4-4539-8a62-6e5dd7e62550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:21.493339 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bca0e-bca4-4539-8a62-6e5dd7e62550 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:21.525665 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1389/2761] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:21 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:21.529638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58516144-2a9a-4eb0-b5a1-e7908ceeab9c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:21.552316 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58516144-2a9a-4eb0-b5a1-e7908ceeab9c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:21.560732 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2429b-8c53-4c8d-a27a-3fa3a641f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:21.561456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2429b-8c53-4c8d-a27a-3fa3a641f3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.561745 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2429b-8c53-4c8d-a27a-3fa3a641f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.562432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2429b-8c53-4c8d-a27a-3fa3a641f3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.563064 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2429b-8c53-4c8d-a27a-3fa3a641f3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:21.565583 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2429b-8c53-4c8d-a27a-3fa3a641f3c7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:21.577184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1373/2762] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:21.581454 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bca0e-bca4-4539-8a62-6e5dd7e62550 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:21.592853 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bca0e-bca4-4539-8a62-6e5dd7e62550 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:21.598678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595308a-9d47-4769-8448-3067ddc6242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:21.599065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595308a-9d47-4769-8448-3067ddc6242e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.599346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595308a-9d47-4769-8448-3067ddc6242e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.599624 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595308a-9d47-4769-8448-3067ddc6242e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.600294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595308a-9d47-4769-8448-3067ddc6242e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:21.601929 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595308a-9d47-4769-8448-3067ddc6242e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:21.618696 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1390/2763] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:21.624260 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2429b-8c53-4c8d-a27a-3fa3a641f3c7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:21.647056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2429b-8c53-4c8d-a27a-3fa3a641f3c7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:21.655955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:21.657169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.657706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.658460 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] PATH_INFO: `/v3/projects/c88bbc45827e4dd3b84c1546f4fbf906/users/14f3ba7631ba478ba9edfe056305484b/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.688030 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88bbc45827e4dd3b84c1546f4fbf906, user_id=14f3ba7631ba478ba9edfe056305484b, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:21.692844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:21.713328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1374/2764] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:21 2022] PUT /identity/v3/projects/c88bbc45827e4dd3b84c1546f4fbf906/users/14f3ba7631ba478ba9edfe056305484b/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:21.724106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214064-4cd8-4685-b318-360f53369087 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:21.724421 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214064-4cd8-4685-b318-360f53369087 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:21.724658 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214064-4cd8-4685-b318-360f53369087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:21.762012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a5214064-4cd8-4685-b318-360f53369087 None None] MFA Rules not processed for user `14f3ba7631ba478ba9edfe056305484b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:21.763472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5214064-4cd8-4685-b318-360f53369087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:21.898827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1391/2765] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:21.914934 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:21.919412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:22.040823 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f864a-15b7-43ed-bb6e-3207ebb746f5 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:22.047808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:22.049529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:22.050620 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:22.051369 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:22.069394 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:22.072546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:22.092360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1375/2766] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:26.668704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb0a8-dfa7-47d9-aca2-e6bebc8794c4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:26.669375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb0a8-dfa7-47d9-aca2-e6bebc8794c4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:26.669375 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb0a8-dfa7-47d9-aca2-e6bebc8794c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:26.727112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8b8cb0a8-dfa7-47d9-aca2-e6bebc8794c4 None None] MFA Rules not processed for user `6f56c04652d4406a8af97bd4b0268bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:26.728854 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8b8cb0a8-dfa7-47d9-aca2-e6bebc8794c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:26.855065 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1392/2767] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:26.856537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:26.859587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:26.969066 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:27.016322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b007a-ed7b-4523-acf1-860609c7fe5b service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:27.025994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6a3be-3f0c-46b7-a2d1-1767b0bd781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:27.027080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6a3be-3f0c-46b7-a2d1-1767b0bd781b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.027473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6a3be-3f0c-46b7-a2d1-1767b0bd781b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.027893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6a3be-3f0c-46b7-a2d1-1767b0bd781b admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.028577 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6a3be-3f0c-46b7-a2d1-1767b0bd781b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:27.030604 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6a3be-3f0c-46b7-a2d1-1767b0bd781b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:27.094252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1376/2768] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:26 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:29:27.102204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb0a8-dfa7-47d9-aca2-e6bebc8794c4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:27.120238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb0a8-dfa7-47d9-aca2-e6bebc8794c4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:27.125314 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:27.223521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee122-280c-4251-a667-6ba4c14e40c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:27.224159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee122-280c-4251-a667-6ba4c14e40c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.224445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee122-280c-4251-a667-6ba4c14e40c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.224720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee122-280c-4251-a667-6ba4c14e40c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.225371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ee122-280c-4251-a667-6ba4c14e40c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:27.227430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ee122-280c-4251-a667-6ba4c14e40c2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:27.257885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1393/2769] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:27 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:27.263914 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6a3be-3f0c-46b7-a2d1-1767b0bd781b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:27.279418 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6a3be-3f0c-46b7-a2d1-1767b0bd781b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:27.286092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dad619-48db-4ee3-95be-1ba06b167d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:27.286899 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dad619-48db-4ee3-95be-1ba06b167d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.287255 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dad619-48db-4ee3-95be-1ba06b167d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.287589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dad619-48db-4ee3-95be-1ba06b167d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.288456 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dad619-48db-4ee3-95be-1ba06b167d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:27.290872 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dad619-48db-4ee3-95be-1ba06b167d3e admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:27.304630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1377/2770] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:27.311735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee122-280c-4251-a667-6ba4c14e40c2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:27.324233 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee122-280c-4251-a667-6ba4c14e40c2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:27.332927 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16d356-cdbe-4294-9932-a5974c7cda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:27.334094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16d356-cdbe-4294-9932-a5974c7cda85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.335633 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16d356-cdbe-4294-9932-a5974c7cda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.336076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16d356-cdbe-4294-9932-a5974c7cda85 admin admin] PATH_INFO: `/v3/projects/403cf54f694d4942add76bc039504be5/users/18a6a4b8c47a4d31a217a0ae616446a3/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.375711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16d356-cdbe-4294-9932-a5974c7cda85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403cf54f694d4942add76bc039504be5, user_id=18a6a4b8c47a4d31a217a0ae616446a3, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:27.381681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16d356-cdbe-4294-9932-a5974c7cda85 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:27.404749 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1394/2771] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:27 2022] PUT /identity/v3/projects/403cf54f694d4942add76bc039504be5/users/18a6a4b8c47a4d31a217a0ae616446a3/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:27.412569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dad619-48db-4ee3-95be-1ba06b167d3e admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:27.425071 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dad619-48db-4ee3-95be-1ba06b167d3e admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:27.508536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f57fc-19cd-4e78-b639-1cd950b838a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:27.509359 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f57fc-19cd-4e78-b639-1cd950b838a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.509641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f57fc-19cd-4e78-b639-1cd950b838a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.509917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f57fc-19cd-4e78-b639-1cd950b838a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.510685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f57fc-19cd-4e78-b639-1cd950b838a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:27.512329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f57fc-19cd-4e78-b639-1cd950b838a0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:27.530407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1378/2772] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:27.535695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16d356-cdbe-4294-9932-a5974c7cda85 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:27.550451 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16d356-cdbe-4294-9932-a5974c7cda85 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:27.557429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:27.558532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.559004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.559467 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] PATH_INFO: `/v3/projects/403cf54f694d4942add76bc039504be5/users/18a6a4b8c47a4d31a217a0ae616446a3/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.571039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403cf54f694d4942add76bc039504be5, user_id=18a6a4b8c47a4d31a217a0ae616446a3, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:27.574325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:27.588210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1395/2773] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:27 2022] PUT /identity/v3/projects/403cf54f694d4942add76bc039504be5/users/18a6a4b8c47a4d31a217a0ae616446a3/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:34.034549 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efab8-4d1b-41a9-878b-cf45cd6d0121 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:34.035183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efab8-4d1b-41a9-878b-cf45cd6d0121 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:34.035557 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efab8-4d1b-41a9-878b-cf45cd6d0121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:34.089366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-d24efab8-4d1b-41a9-878b-cf45cd6d0121 None None] MFA Rules not processed for user `18a6a4b8c47a4d31a217a0ae616446a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:34.091761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d24efab8-4d1b-41a9-878b-cf45cd6d0121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:34.342329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1379/2774] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:34.359612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:34.363220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:34.512427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347fe1c-f6b6-4cf7-ba42-b512af0e9b72 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:34.518767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9452756fb5049678dd3aac0d5be651d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:34.520106 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:34.520220 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:34.520623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:34.609523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:34.619500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:34.621721 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:34.634641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1396/2775] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:34.947971 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f0ca-56ce-4873-bc41-d61a5ef5a4d8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:34.948306 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f0ca-56ce-4873-bc41-d61a5ef5a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:34.948580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f0ca-56ce-4873-bc41-d61a5ef5a4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:35.039111 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:35.068541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-1244f0ca-56ce-4873-bc41-d61a5ef5a4d8 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:35.070409 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-1244f0ca-56ce-4873-bc41-d61a5ef5a4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:35.208661 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1380/2776] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:29:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:35.261679 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:35.263753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:35.419544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49338b7-23d1-4191-922d-31ad1d49a758 service glance] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:35.426418 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f58c8-2c96-48b2-a4f7-15ce95699b35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:35.427095 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f58c8-2c96-48b2-a4f7-15ce95699b35 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:35.427486 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f58c8-2c96-48b2-a4f7-15ce95699b35 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:35.427866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f58c8-2c96-48b2-a4f7-15ce95699b35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:35.442157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f58c8-2c96-48b2-a4f7-15ce95699b35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:35.444598 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f58c8-2c96-48b2-a4f7-15ce95699b35 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:35.459401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1397/2777] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 08:29:40.091706 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f0ca-56ce-4873-bc41-d61a5ef5a4d8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:40.195606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f0ca-56ce-4873-bc41-d61a5ef5a4d8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:40.200539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:40.201169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:40.201455 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:40.201734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] PATH_INFO: `/v3/users/14f3ba7631ba478ba9edfe056305484b` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:40.202892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f3ba7631ba478ba9edfe056305484b)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:40.205328 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:40.276276 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f3ba7631ba478ba9edfe056305484b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:40.285611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f3ba7631ba478ba9edfe056305484b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:40.286502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f3ba7631ba478ba9edfe056305484b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:40.295924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f3ba7631ba478ba9edfe056305484b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:40.321006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f3ba7631ba478ba9edfe056305484b'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:40.331921 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1381/2778] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:40 2022] DELETE /identity/v3/users/14f3ba7631ba478ba9edfe056305484b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:40.338733 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d942c-fa6a-4c0b-9342-11bf1de9f1f7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:40.339656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d942c-fa6a-4c0b-9342-11bf1de9f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:40.339656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d942c-fa6a-4c0b-9342-11bf1de9f1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:40.363510 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-005d942c-fa6a-4c0b-9342-11bf1de9f1f7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:40.365557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-005d942c-fa6a-4c0b-9342-11bf1de9f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:40.492037 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1398/2779] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:40.502698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:40.504483 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:40.524457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:40.625761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a95fa-79a3-4dbc-869f-a6b323bbbdf7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:40.630171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae04ad-25be-4759-a850-a6871c8419f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:40.631326 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae04ad-25be-4759-a850-a6871c8419f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:40.631793 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae04ad-25be-4759-a850-a6871c8419f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:40.632248 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae04ad-25be-4759-a850-a6871c8419f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:40.648468 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae04ad-25be-4759-a850-a6871c8419f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:40.650125 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae04ad-25be-4759-a850-a6871c8419f5 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:40.686790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1382/2780] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:41.109325 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d942c-fa6a-4c0b-9342-11bf1de9f1f7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:41.112847 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-005d942c-fa6a-4c0b-9342-11bf1de9f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:41.128496 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d942c-fa6a-4c0b-9342-11bf1de9f1f7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:41.134972 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:41.135688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:41.136124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:41.136411 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] PATH_INFO: `/v3/projects/c88bbc45827e4dd3b84c1546f4fbf906` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:41.137844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88bbc45827e4dd3b84c1546f4fbf906)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:41.140699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:41.227652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88bbc45827e4dd3b84c1546f4fbf906', 'request_id': 'req-9524f26c-9d68-4333-9d37-a8db4014e31b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:41.241935 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88bbc45827e4dd3b84c1546f4fbf906', 'request_id': 'req-9524f26c-9d68-4333-9d37-a8db4014e31b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:41.246753 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:41.249240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88bbc45827e4dd3b84c1546f4fbf906', 'request_id': 'req-9524f26c-9d68-4333-9d37-a8db4014e31b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:41.279756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] The token cache is being invalidate because project c88bbc45827e4dd3b84c1546f4fbf906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:41.280247 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:41.281251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9524f26c-9d68-4333-9d37-a8db4014e31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:41.285115 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1399/2781] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:41 2022] DELETE /identity/v3/projects/c88bbc45827e4dd3b84c1546f4fbf906 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:45.283972 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f52e-2aa8-4948-8ca3-eeffc13b852d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:45.284541 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f52e-2aa8-4948-8ca3-eeffc13b852d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:45.284737 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f52e-2aa8-4948-8ca3-eeffc13b852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:45.309549 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-aa02f52e-2aa8-4948-8ca3-eeffc13b852d None None] MFA Rules not processed for user `6f56c04652d4406a8af97bd4b0268bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:45.311027 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aa02f52e-2aa8-4948-8ca3-eeffc13b852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:45.370853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1383/2782] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:29:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:51.266645 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=2,keystone:SELECT=3,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:55.364247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=45 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:01.290602 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf787a-9a14-470c-b093-c762884f17aa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:01.291119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf787a-9a14-470c-b093-c762884f17aa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:01.291281 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf787a-9a14-470c-b093-c762884f17aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:01.311594 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7dbf787a-9a14-470c-b093-c762884f17aa None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:30:01.312824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7dbf787a-9a14-470c-b093-c762884f17aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:01.371023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1400/2783] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:30:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:30:01.383044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02f52e-2aa8-4948-8ca3-eeffc13b852d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:01.384406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aa02f52e-2aa8-4948-8ca3-eeffc13b852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:01.451332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02f52e-2aa8-4948-8ca3-eeffc13b852d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:01.456515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5c07-ed79-428b-8251-151282b5f73a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:01.457113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5c07-ed79-428b-8251-151282b5f73a service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:01.457391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5c07-ed79-428b-8251-151282b5f73a service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:01.457660 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b5c07-ed79-428b-8251-151282b5f73a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:01.465452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b5c07-ed79-428b-8251-151282b5f73a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:01.467063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b5c07-ed79-428b-8251-151282b5f73a service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:01.476124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1384/2784] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:30:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:30:01.998915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da150017-58e1-4591-9966-6ddb3d0a7244 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:01.999198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da150017-58e1-4591-9966-6ddb3d0a7244 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:01.999472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da150017-58e1-4591-9966-6ddb3d0a7244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:02.019606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-da150017-58e1-4591-9966-6ddb3d0a7244 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:30:02.020729 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-da150017-58e1-4591-9966-6ddb3d0a7244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:02.028159 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1401/2785] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 08:30:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:30:02.041344 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5c07-ed79-428b-8251-151282b5f73a service swift] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:02.051890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b5c07-ed79-428b-8251-151282b5f73a service swift] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:02.056851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d0cd9-b1aa-4236-99cf-e00045b0ae3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:02.057452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0cd9-b1aa-4236-99cf-e00045b0ae3f service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:02.057729 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0cd9-b1aa-4236-99cf-e00045b0ae3f service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:02.058022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0cd9-b1aa-4236-99cf-e00045b0ae3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:02.067151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d0cd9-b1aa-4236-99cf-e00045b0ae3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:02.068713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d0cd9-b1aa-4236-99cf-e00045b0ae3f service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:02.076945 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1385/2786] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 08:30:02.303913 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911e911-487b-4109-87a4-304e99b1eb23 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:02.304427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911e911-487b-4109-87a4-304e99b1eb23 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:02.304550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911e911-487b-4109-87a4-304e99b1eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:02.324246 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e911e911-487b-4109-87a4-304e99b1eb23 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:30:02.325437 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e911e911-487b-4109-87a4-304e99b1eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:02.333543 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1402/2787] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:30:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:30:02.347183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d0cd9-b1aa-4236-99cf-e00045b0ae3f service swift] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:02.358209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d0cd9-b1aa-4236-99cf-e00045b0ae3f service swift] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:02.364281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029585ee-54ea-4a83-918c-0f315d1460fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:02.364884 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029585ee-54ea-4a83-918c-0f315d1460fe service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:02.365169 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029585ee-54ea-4a83-918c-0f315d1460fe service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:02.365440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029585ee-54ea-4a83-918c-0f315d1460fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:02.374449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029585ee-54ea-4a83-918c-0f315d1460fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:02.376712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029585ee-54ea-4a83-918c-0f315d1460fe service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:02.385711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1386/2788] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:30:02.728399 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d5327-2693-4f97-9b1e-44d232df85b1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:02.728687 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d5327-2693-4f97-9b1e-44d232df85b1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:02.728965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d5327-2693-4f97-9b1e-44d232df85b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:02.748900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-901d5327-2693-4f97-9b1e-44d232df85b1 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:30:02.750116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-901d5327-2693-4f97-9b1e-44d232df85b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:02.757614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1403/2789] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 08:30:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:30:02.769852 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029585ee-54ea-4a83-918c-0f315d1460fe service swift] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:02.780184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029585ee-54ea-4a83-918c-0f315d1460fe service swift] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:02.785672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:02.786288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:02.786573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:02.786845 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:02.794882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:02.796388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:02.805373 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1387/2790] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:30:03.569123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d5327-2693-4f97-9b1e-44d232df85b1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:03.570746 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-901d5327-2693-4f97-9b1e-44d232df85b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:03.646971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d5327-2693-4f97-9b1e-44d232df85b1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:03.652077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54a6f1-5552-4e6c-ab89-e641e204741b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:03.652708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a6f1-5552-4e6c-ab89-e641e204741b service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:03.652990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a6f1-5552-4e6c-ab89-e641e204741b service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:03.653270 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a6f1-5552-4e6c-ab89-e641e204741b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:03.654997 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8a54a6f1-5552-4e6c-ab89-e641e204741b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:03.667521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54a6f1-5552-4e6c-ab89-e641e204741b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:03.669083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54a6f1-5552-4e6c-ab89-e641e204741b service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:03.682483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1404/2791] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:30:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:30:04.969412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:04.970865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:05.040847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc20b8-c86f-4aad-8cda-8a87c66aa3c1 service swift] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:05.045476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:05.046105 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:05.046424 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:05.046702 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] PATH_INFO: `/v3/users/52600a45490f46cf944278b2d0684080` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:05.047830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52600a45490f46cf944278b2d0684080)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:05.049720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:05.099473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52600a45490f46cf944278b2d0684080'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.104608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:05.108734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52600a45490f46cf944278b2d0684080'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.109517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52600a45490f46cf944278b2d0684080'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.118223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52600a45490f46cf944278b2d0684080'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.130808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52600a45490f46cf944278b2d0684080'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.136633 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1388/2792] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:30:04 2022] DELETE /identity/v3/users/52600a45490f46cf944278b2d0684080 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:30:05.141112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbce1e-3a19-42be-af99-002783a99ffc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:05.141630 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbce1e-3a19-42be-af99-002783a99ffc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:05.141736 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbce1e-3a19-42be-af99-002783a99ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:05.160762 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2ebbce1e-3a19-42be-af99-002783a99ffc None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:30:05.161947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ebbce1e-3a19-42be-af99-002783a99ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:05.220593 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1405/2793] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:30:05.230308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:05.231730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:05.287839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887be40e-b8c3-4ee4-89ee-fb49690318d2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:05.291522 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632993-7823-465d-be60-335d66da476f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:05.292122 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632993-7823-465d-be60-335d66da476f service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:05.292402 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632993-7823-465d-be60-335d66da476f service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:05.292677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632993-7823-465d-be60-335d66da476f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:05.302237 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632993-7823-465d-be60-335d66da476f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:05.303708 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632993-7823-465d-be60-335d66da476f service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:05.312848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1389/2794] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:30:05.593991 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbce1e-3a19-42be-af99-002783a99ffc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:05.595966 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ebbce1e-3a19-42be-af99-002783a99ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:05.608589 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbce1e-3a19-42be-af99-002783a99ffc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:05.614186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:05.614989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:05.615362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:05.615703 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] PATH_INFO: `/v3/projects/34ed36f6fed0453c9f341c358c347dcb` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:05.616973 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ed36f6fed0453c9f341c358c347dcb)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:05.619164 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:05.630930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:05.668725 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ed36f6fed0453c9f341c358c347dcb', 'request_id': 'req-84efce7b-27c8-4ba7-ab59-3869c99a5e14'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.675862 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ed36f6fed0453c9f341c358c347dcb', 'request_id': 'req-84efce7b-27c8-4ba7-ab59-3869c99a5e14'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.681818 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ed36f6fed0453c9f341c358c347dcb', 'request_id': 'req-84efce7b-27c8-4ba7-ab59-3869c99a5e14'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.695287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] The token cache is being invalidate because project 34ed36f6fed0453c9f341c358c347dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:30:05.695588 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.696236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:30:05.697743 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1406/2795] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:30:05 2022] DELETE /identity/v3/projects/34ed36f6fed0453c9f341c358c347dcb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:30:15.308798 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=36,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:15.692010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:47.968372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632993-7823-465d-be60-335d66da476f service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:47.978431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632993-7823-465d-be60-335d66da476f service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:48.035013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:48.035630 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:48.035912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:48.036186 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:48.037952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:48.052156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:48.053968 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:48.070724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efce7b-27c8-4ba7-ab59-3869c99a5e14 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:48.075989 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:48.078064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:48.078426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:48.078659 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:48.081488 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:48.119307 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:48.121283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:48.133624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1390/2796] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:30:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:30:48.180558 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:48.182027 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:48.195320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1407/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:30:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:30:58.128184 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=54 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:58.188971 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=34 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:24.149354 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:31:24.157920 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1d51-b7b3-4674-9be7-44231bbf8360 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:31:24.162358 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:31:24.162958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:31:24.163234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:31:24.163500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:31:24.165544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:31:24.230005 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:31:24.231488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:31:24.241210 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1391/2798] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:31:24.795121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:31:24.796662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:31:24.811796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539996f-0899-4350-a4aa-6bb9c2e9ef3a service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:31:24.818607 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:31:24.819523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:31:24.819523 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:31:24.819787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] PATH_INFO: `/v3/users/d713712c30574895b82beedb9c4f251d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:31:24.820998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d713712c30574895b82beedb9c4f251d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:31:24.822956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:31:24.872218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd713712c30574895b82beedb9c4f251d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:24.879406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd713712c30574895b82beedb9c4f251d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:24.880839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd713712c30574895b82beedb9c4f251d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:24.888453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd713712c30574895b82beedb9c4f251d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:24.889350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd713712c30574895b82beedb9c4f251d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:24.906952 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1408/2799] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:31:24 2022] DELETE /identity/v3/users/d713712c30574895b82beedb9c4f251d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:31:25.090994 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:31:25.102040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db71530-3835-4732-8d54-c51acc764aaf service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:31:25.163291 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:31:25.164013 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:31:25.164192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:31:25.164465 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] PATH_INFO: `/v3/projects/82d7e2503aa043929798769c22c1b2da` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:31:25.165610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d7e2503aa043929798769c22c1b2da)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:31:25.167694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:31:25.216054 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d7e2503aa043929798769c22c1b2da', 'request_id': 'req-d2691bf5-3074-441c-aba1-05eb914ff728'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:25.222302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d7e2503aa043929798769c22c1b2da', 'request_id': 'req-d2691bf5-3074-441c-aba1-05eb914ff728'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:25.230302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d7e2503aa043929798769c22c1b2da', 'request_id': 'req-d2691bf5-3074-441c-aba1-05eb914ff728'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:25.242573 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] The token cache is being invalidate because project 82d7e2503aa043929798769c22c1b2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:31:25.242878 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:25.243548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:31:25.245016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1392/2800] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:31:25 2022] DELETE /identity/v3/projects/82d7e2503aa043929798769c22c1b2da => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:31:34.902745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:35.238685 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:32:30.017789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:32:30.019683 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:32:30.098572 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d3387-92fb-4f83-88e8-cfaa3742ac49 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:32:30.169176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:32:30.170187 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:32:30.170618 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:32:30.170902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:32:30.172864 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:32:30.256059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:32:30.258216 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:32:30.276257 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1409/2801] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:32:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:32:40.273694 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:35.178607 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:35.180042 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:35.274547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2691bf5-3074-441c-aba1-05eb914ff728 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:35.280308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a58a2b-ba47-426e-a445-cea83c80067d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:35.280962 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a58a2b-ba47-426e-a445-cea83c80067d service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:35.281245 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a58a2b-ba47-426e-a445-cea83c80067d service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:35.281543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a58a2b-ba47-426e-a445-cea83c80067d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:35.283303 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-50a58a2b-ba47-426e-a445-cea83c80067d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:35.340154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a58a2b-ba47-426e-a445-cea83c80067d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:35.341750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a58a2b-ba47-426e-a445-cea83c80067d service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:35.350727 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1393/2802] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:38.497288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:38.498781 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:38.623128 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28536cb-85a4-4149-8bef-dfe6931ad575 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:38.628170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:38.628797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:38.629076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:38.629349 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:38.631080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:38.643346 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:38.645063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:38.655341 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1410/2803] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:41.759132 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71468-b3e9-40a2-90e8-53be61b4589d None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:41.759642 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71468-b3e9-40a2-90e8-53be61b4589d None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:41.759750 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71468-b3e9-40a2-90e8-53be61b4589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:41.790029 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-19e71468-b3e9-40a2-90e8-53be61b4589d None None] MFA Rules not processed for user `ccd2c619e9fc436ea01a1200bc46b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:34:41.791289 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-19e71468-b3e9-40a2-90e8-53be61b4589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:41.798932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1394/2804] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:34:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:34:42.136426 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:42.138082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:42.196860 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d783f7c-3c4e-42ee-9f39-522c56c3ebf2 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:42.200376 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:42.200980 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:42.201260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:42.201534 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:42.204415 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:42.213823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:42.215260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:42.223442 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1411/2805] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:34:42.560651 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71468-b3e9-40a2-90e8-53be61b4589d None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:42.562223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-19e71468-b3e9-40a2-90e8-53be61b4589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:42.579873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71468-b3e9-40a2-90e8-53be61b4589d None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:42.586758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78c7df-4772-4fca-82e0-fb399485401f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:42.587434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78c7df-4772-4fca-82e0-fb399485401f service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:42.587716 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78c7df-4772-4fca-82e0-fb399485401f service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:42.587991 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78c7df-4772-4fca-82e0-fb399485401f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:42.589770 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6b78c7df-4772-4fca-82e0-fb399485401f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:42.601873 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78c7df-4772-4fca-82e0-fb399485401f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:42.603565 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78c7df-4772-4fca-82e0-fb399485401f service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:42.614211 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1395/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:52.219923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=80 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:52.609287 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=74 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:10.555024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:10.578878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5827e-c456-4af1-8ee1-0d1bd572a101 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:10.584893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:10.585518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:10.585796 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:10.586068 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:10.587873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:10.617328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:10.620265 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:10.635812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1412/2807] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:20.630754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=15 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:46.632312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac0d5-e908-415e-8ce8-43d46898b8d2 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:46.633140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac0d5-e908-415e-8ce8-43d46898b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:46.633140 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eac0d5-e908-415e-8ce8-43d46898b8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:46.656640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-52eac0d5-e908-415e-8ce8-43d46898b8d2 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:35:46.657886 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-52eac0d5-e908-415e-8ce8-43d46898b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:46.718484 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1396/2808] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 08:35:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:35:46.772751 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:46.774178 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:46.861987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e3d4-41f2-488e-a4ef-55c801b6a751 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:46.867390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f6caa-341a-4059-93b4-ea0bbe89e81f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:46.868010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f6caa-341a-4059-93b4-ea0bbe89e81f service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:46.868290 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f6caa-341a-4059-93b4-ea0bbe89e81f service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:46.868563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f6caa-341a-4059-93b4-ea0bbe89e81f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:46.878554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f6caa-341a-4059-93b4-ea0bbe89e81f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:46.880163 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f6caa-341a-4059-93b4-ea0bbe89e81f service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:46.889409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1413/2809] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 08:35:47.243322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eac0d5-e908-415e-8ce8-43d46898b8d2 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:47.245628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-52eac0d5-e908-415e-8ce8-43d46898b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:47.290698 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eac0d5-e908-415e-8ce8-43d46898b8d2 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:47.294407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:47.295028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:47.295311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:47.295587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:47.297372 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:47.400442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:47.401930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:47.421999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1397/2810] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:48.801684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f6caa-341a-4059-93b4-ea0bbe89e81f service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:48.814583 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f6caa-341a-4059-93b4-ea0bbe89e81f service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:48.820016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:48.820639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:48.820912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:48.821380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:48.823254 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:48.839511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:48.840999 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:48.853754 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1414/2811] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:49.974619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:49.984430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76516b6b-8da8-422c-a655-5e99f33a9b28 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:49.988524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:49.989238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:49.989608 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:49.990008 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:49.992075 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:50.015978 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:50.018086 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:50.031370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1398/2812] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:50.849779 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:50.875550 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59370b19-744f-488b-a5ae-fe2335588192 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:50.883013 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:50.883797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:50.884188 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:50.884445 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:50.886916 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:50.908532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:50.913172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:50.935717 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1415/2813] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:54.365371 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:54.381695 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708cc80-a64d-4ee3-a654-d82161d18972 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:54.387338 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:54.388295 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:54.389474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:54.390001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:54.392632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:54.409319 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:54.410864 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:54.428205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1399/2814] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:35:54.477091 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:54.481023 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:54.495120 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a9fda-3cbe-4d9c-96e5-e14fb1225c52 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:54.500137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:54.500797 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:54.501076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:54.501342 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] PATH_INFO: `/v3/users/6f56c04652d4406a8af97bd4b0268bc6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:54.504657 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f56c04652d4406a8af97bd4b0268bc6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:54.505937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:54.569137 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f56c04652d4406a8af97bd4b0268bc6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:54.580639 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f56c04652d4406a8af97bd4b0268bc6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:54.582103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f56c04652d4406a8af97bd4b0268bc6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:54.592392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f56c04652d4406a8af97bd4b0268bc6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:54.593531 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f56c04652d4406a8af97bd4b0268bc6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:54.631953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1416/2815] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:35:54 2022] DELETE /identity/v3/users/6f56c04652d4406a8af97bd4b0268bc6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:35:54.877421 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:54.893209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7a124-74ad-46b6-b3ae-c89cc6a3bf8b service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:54.931719 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=100 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:54.986167 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:54.986844 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:54.987152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:54.987432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] PATH_INFO: `/v3/projects/5d7a479aae1144f289a9c79417c064b4` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:54.988668 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7a479aae1144f289a9c79417c064b4)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:54.990686 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:55.046883 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7a479aae1144f289a9c79417c064b4', 'request_id': 'req-d1092db9-229d-4081-8173-c67604960970'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.054434 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7a479aae1144f289a9c79417c064b4', 'request_id': 'req-d1092db9-229d-4081-8173-c67604960970'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.064006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7a479aae1144f289a9c79417c064b4', 'request_id': 'req-d1092db9-229d-4081-8173-c67604960970'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.077467 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] The token cache is being invalidate because project 5d7a479aae1144f289a9c79417c064b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:35:55.077771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.078469 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.080157 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1400/2816] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:35:54 2022] DELETE /identity/v3/projects/5d7a479aae1144f289a9c79417c064b4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:35:55.085362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:55.086928 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:55.101673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3689-5edd-4c6e-abac-1b23a330093d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:55.140514 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:55.169684 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:55.170362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:55.170641 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:55.170911 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] PATH_INFO: `/v3/users/18a6a4b8c47a4d31a217a0ae616446a3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:55.172066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a6a4b8c47a4d31a217a0ae616446a3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:55.174017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:55.242078 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a6a4b8c47a4d31a217a0ae616446a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.250002 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a6a4b8c47a4d31a217a0ae616446a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.250780 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a6a4b8c47a4d31a217a0ae616446a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.261025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a6a4b8c47a4d31a217a0ae616446a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.261674 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a6a4b8c47a4d31a217a0ae616446a3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.281344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1417/2817] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:35:55 2022] DELETE /identity/v3/users/18a6a4b8c47a4d31a217a0ae616446a3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:35:55.490909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:55.493329 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:55.523713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1092db9-229d-4081-8173-c67604960970 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:55.594779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:55.595442 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:55.595720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:55.595996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] PATH_INFO: `/v3/projects/403cf54f694d4942add76bc039504be5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:55.598731 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=403cf54f694d4942add76bc039504be5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:55.600673 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:55.656480 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403cf54f694d4942add76bc039504be5', 'request_id': 'req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.664623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403cf54f694d4942add76bc039504be5', 'request_id': 'req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.667524 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:55.674712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403cf54f694d4942add76bc039504be5', 'request_id': 'req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.688232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] The token cache is being invalidate because project 403cf54f694d4942add76bc039504be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:35:55.688544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.689201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:55.691232 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1401/2818] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:35:55 2022] DELETE /identity/v3/projects/403cf54f694d4942add76bc039504be5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:36:05.277681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:05.685776 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:DELETE=3,keystone:SELECT=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:37:30.634179 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:37:30.635805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:37:30.709783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0c3d-329e-4e86-855d-ba74477916b3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:37:30.772151 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:37:30.772681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:37:30.772965 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:37:30.773238 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:37:30.774981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:37:30.838132 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:37:30.839752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:37:30.849184 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1418/2819] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:37:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:37:40.844438 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:12.508690 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:12.510451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:12.581759 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48aae1-6679-4ee0-ac02-5c050f39f1cc admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:12.586849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:12.587472 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:12.587756 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:12.588564 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:12.591033 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:12.603171 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:12.605628 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:12.616179 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1402/2820] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:22.611848 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=32 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:44.097592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:44.099081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:44.116800 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08796ea0-d1ea-4444-9571-756ccd79adda service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:44.122826 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:44.123441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.123718 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.123998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.125764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:44.138500 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:44.140081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:44.150655 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1419/2821] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:44.996180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:44.997723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:45.057180 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cc8df-9e68-4b3f-9ca3-77e509047a16 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:45.060935 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:45.061547 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:45.061830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:45.062107 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:45.063916 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:45.131128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:45.132485 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:45.143937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1403/2822] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:48.331087 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:48.332625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:48.352028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23029e9-346b-4401-95e1-b3294756d864 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:48.357552 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:48.358202 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:48.358525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:48.358804 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] PATH_INFO: `/v3/users/ccd2c619e9fc436ea01a1200bc46b60f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:48.360016 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd2c619e9fc436ea01a1200bc46b60f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:48.361959 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:48.418520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd2c619e9fc436ea01a1200bc46b60f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.425695 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd2c619e9fc436ea01a1200bc46b60f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.426520 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd2c619e9fc436ea01a1200bc46b60f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.441359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd2c619e9fc436ea01a1200bc46b60f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.442017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a95829a-1510-4e7c-bc5f-6fb0962b1bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd2c619e9fc436ea01a1200bc46b60f'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.462563 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1420/2823] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:48 2022] DELETE /identity/v3/users/ccd2c619e9fc436ea01a1200bc46b60f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:40:48.658569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:48.669374 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139bf95-1e43-449e-8491-064b4e1231d9 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:48.729576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:48.730476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:48.730764 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:48.731044 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] PATH_INFO: `/v3/projects/e8088d87969e46a2b2cc69dd7297ae14` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:48.732176 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8088d87969e46a2b2cc69dd7297ae14)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:48.734073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:48.781043 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8088d87969e46a2b2cc69dd7297ae14', 'request_id': 'req-3c5a455f-617e-45f8-9aae-d18409ba3c80'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.782909 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:48.787406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8088d87969e46a2b2cc69dd7297ae14', 'request_id': 'req-3c5a455f-617e-45f8-9aae-d18409ba3c80'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.796342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8088d87969e46a2b2cc69dd7297ae14', 'request_id': 'req-3c5a455f-617e-45f8-9aae-d18409ba3c80'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.806694 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] The token cache is being invalidate because project e8088d87969e46a2b2cc69dd7297ae14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:48.806984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.808311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-3c5a455f-617e-45f8-9aae-d18409ba3c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:48.809707 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1404/2824] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:48 2022] DELETE /identity/v3/projects/e8088d87969e46a2b2cc69dd7297ae14 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:48.814650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd0b7-240c-4685-896d-2579ddb977e4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:48.814939 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd0b7-240c-4685-896d-2579ddb977e4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:48.815211 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd0b7-240c-4685-896d-2579ddb977e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:48.872720 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-90acd0b7-240c-4685-896d-2579ddb977e4 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:48.873938 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90acd0b7-240c-4685-896d-2579ddb977e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:48.937312 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1421/2825] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:48.945152 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0bc28-98bf-496e-9c30-428ebfdb0856 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:48.945438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0bc28-98bf-496e-9c30-428ebfdb0856 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:48.945712 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0bc28-98bf-496e-9c30-428ebfdb0856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:48.966118 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-9ff0bc28-98bf-496e-9c30-428ebfdb0856 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:48.967362 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-9ff0bc28-98bf-496e-9c30-428ebfdb0856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:48.975427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1405/2826] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:48.980403 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acd0b7-240c-4685-896d-2579ddb977e4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:48.990632 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acd0b7-240c-4685-896d-2579ddb977e4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:48.996168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:48.996764 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:48.997042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:48.997338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:48.998030 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:40:48.998389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:49.000176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:49.012861 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1422/2827] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:40:49.017258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0bc28-98bf-496e-9c30-428ebfdb0856 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:49.026835 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0bc28-98bf-496e-9c30-428ebfdb0856 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:49.031634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a09e5-c1ae-4348-9952-dddd76ae2e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:49.032370 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a09e5-c1ae-4348-9952-dddd76ae2e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:49.032714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a09e5-c1ae-4348-9952-dddd76ae2e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:49.033053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a09e5-c1ae-4348-9952-dddd76ae2e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:49.034314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a09e5-c1ae-4348-9952-dddd76ae2e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:49.035794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a09e5-c1ae-4348-9952-dddd76ae2e08 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:49.076502 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1406/2828] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:49 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:49.080714 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:49.093024 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b376c3-caed-46e3-963c-40f03577d4ac admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:49.105404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:49.154886 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f6bfc-abdb-4ef6-a1a9-ce8898e00534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:49.155615 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f6bfc-abdb-4ef6-a1a9-ce8898e00534 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:49.155785 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f6bfc-abdb-4ef6-a1a9-ce8898e00534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:49.156054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f6bfc-abdb-4ef6-a1a9-ce8898e00534 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:49.156649 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f6bfc-abdb-4ef6-a1a9-ce8898e00534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:49.158570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f6bfc-abdb-4ef6-a1a9-ce8898e00534 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:49.184483 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1423/2829] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:49 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:40:49.185783 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a09e5-c1ae-4348-9952-dddd76ae2e08 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:49.196624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a09e5-c1ae-4348-9952-dddd76ae2e08 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:49.201182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653e1c-4b73-4f37-9818-9c8251bb4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:49.201772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653e1c-4b73-4f37-9818-9c8251bb4d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:49.202049 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653e1c-4b73-4f37-9818-9c8251bb4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:49.202355 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653e1c-4b73-4f37-9818-9c8251bb4d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:49.203034 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653e1c-4b73-4f37-9818-9c8251bb4d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:49.204599 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653e1c-4b73-4f37-9818-9c8251bb4d44 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:49.214858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1407/2830] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:49.218949 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f6bfc-abdb-4ef6-a1a9-ce8898e00534 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:49.228918 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f6bfc-abdb-4ef6-a1a9-ce8898e00534 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:49.235031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc1256-6e4e-4920-a75c-7bc4f004b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:49.235741 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc1256-6e4e-4920-a75c-7bc4f004b454 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:49.236138 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc1256-6e4e-4920-a75c-7bc4f004b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:49.236472 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc1256-6e4e-4920-a75c-7bc4f004b454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:49.237127 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc1256-6e4e-4920-a75c-7bc4f004b454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:49.238771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc1256-6e4e-4920-a75c-7bc4f004b454 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:49.250057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1424/2831] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:49.254377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653e1c-4b73-4f37-9818-9c8251bb4d44 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:49.264548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653e1c-4b73-4f37-9818-9c8251bb4d44 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:49.269007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:49.269636 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:49.269912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:49.270181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] PATH_INFO: `/v3/projects/a3a785319b884cabbfef94d2e2eb77e5/users/54cf210551544827a13c28abdfa38674/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:49.284875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a785319b884cabbfef94d2e2eb77e5, user_id=54cf210551544827a13c28abdfa38674, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:49.287490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:49.300639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1408/2832] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:49 2022] PUT /identity/v3/projects/a3a785319b884cabbfef94d2e2eb77e5/users/54cf210551544827a13c28abdfa38674/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:49.310456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba8896-a7c5-4b9b-b629-06a8536f38c3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:49.310763 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba8896-a7c5-4b9b-b629-06a8536f38c3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:49.311036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba8896-a7c5-4b9b-b629-06a8536f38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:49.339102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b3ba8896-a7c5-4b9b-b629-06a8536f38c3 None None] MFA Rules not processed for user `54cf210551544827a13c28abdfa38674`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:49.340326 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b3ba8896-a7c5-4b9b-b629-06a8536f38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:49.405006 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1425/2833] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:40:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:40:49.417458 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:49.419477 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:49.505108 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103455a-4028-4199-8b46-5d6cd6138b7d admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:49.508894 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1283e9-9eb2-46f1-9bae-9aea5f8f35d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:49.509511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1283e9-9eb2-46f1-9bae-9aea5f8f35d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:49.509790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1283e9-9eb2-46f1-9bae-9aea5f8f35d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:49.510069 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1283e9-9eb2-46f1-9bae-9aea5f8f35d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:49.520007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1283e9-9eb2-46f1-9bae-9aea5f8f35d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:49.521440 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1283e9-9eb2-46f1-9bae-9aea5f8f35d6 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:49.531236 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1409/2834] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:40:50.927017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba8896-a7c5-4b9b-b629-06a8536f38c3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:50.928469 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b3ba8896-a7c5-4b9b-b629-06a8536f38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:50.940902 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba8896-a7c5-4b9b-b629-06a8536f38c3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:50.944650 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:50.945186 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:50.945468 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:50.945745 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:50.948351 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:51.023031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:51.024460 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:51.036846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1426/2835] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:52.450045 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1283e9-9eb2-46f1-9bae-9aea5f8f35d6 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.459080 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1283e9-9eb2-46f1-9bae-9aea5f8f35d6 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.462724 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfa8f1-a2db-407d-b76c-84fda1c87941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.463376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa8f1-a2db-407d-b76c-84fda1c87941 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.463569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa8f1-a2db-407d-b76c-84fda1c87941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.463847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa8f1-a2db-407d-b76c-84fda1c87941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.465529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-04cfa8f1-a2db-407d-b76c-84fda1c87941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:52.480495 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfa8f1-a2db-407d-b76c-84fda1c87941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.481930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfa8f1-a2db-407d-b76c-84fda1c87941 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.493451 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1410/2836] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:58.180157 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:58.190021 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:58.246126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e868e78-9138-424a-854b-6ab6d0fdb716 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:58.250708 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:58.251334 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:58.251613 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:58.251888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] PATH_INFO: `/v3/users/54cf210551544827a13c28abdfa38674` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:58.253083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54cf210551544827a13c28abdfa38674)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:58.255067 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:58.310880 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54cf210551544827a13c28abdfa38674'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.318573 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54cf210551544827a13c28abdfa38674'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.319304 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54cf210551544827a13c28abdfa38674'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.329425 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54cf210551544827a13c28abdfa38674'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.330158 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54cf210551544827a13c28abdfa38674'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.348747 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1427/2837] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:58 2022] DELETE /identity/v3/users/54cf210551544827a13c28abdfa38674 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:58.353454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d8a4-76df-48e5-bf62-de70efd457e5 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:58.354611 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d8a4-76df-48e5-bf62-de70efd457e5 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:58.354733 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d8a4-76df-48e5-bf62-de70efd457e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:58.374332 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-7c06d8a4-76df-48e5-bf62-de70efd457e5 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:58.375491 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7c06d8a4-76df-48e5-bf62-de70efd457e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:58.411457 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:58.441967 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1411/2838] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:58.452309 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:58.453795 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:58.515012 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb769-ccb9-4383-bede-9f782ad6967a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:58.518846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d774684-bf73-452b-8130-1023da73e2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:58.519466 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d774684-bf73-452b-8130-1023da73e2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:58.519799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d774684-bf73-452b-8130-1023da73e2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:58.520082 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d774684-bf73-452b-8130-1023da73e2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:58.532071 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d774684-bf73-452b-8130-1023da73e2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:58.533527 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d774684-bf73-452b-8130-1023da73e2ca service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:58.544288 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1428/2839] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:58.835672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06d8a4-76df-48e5-bf62-de70efd457e5 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:58.837156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-7c06d8a4-76df-48e5-bf62-de70efd457e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:58.851907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06d8a4-76df-48e5-bf62-de70efd457e5 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:58.856827 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:58.857478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:58.857762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:58.858038 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] PATH_INFO: `/v3/projects/a3a785319b884cabbfef94d2e2eb77e5` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:58.859285 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a785319b884cabbfef94d2e2eb77e5)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:58.861181 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:58.916497 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a785319b884cabbfef94d2e2eb77e5', 'request_id': 'req-d452d299-b4a8-48df-8eba-82fb2ea94aa9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.923063 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a785319b884cabbfef94d2e2eb77e5', 'request_id': 'req-d452d299-b4a8-48df-8eba-82fb2ea94aa9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.931398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a785319b884cabbfef94d2e2eb77e5', 'request_id': 'req-d452d299-b4a8-48df-8eba-82fb2ea94aa9'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.944384 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] The token cache is being invalidate because project a3a785319b884cabbfef94d2e2eb77e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:58.944632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.945244 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-d452d299-b4a8-48df-8eba-82fb2ea94aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:58.947050 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1412/2840] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:58 2022] DELETE /identity/v3/projects/a3a785319b884cabbfef94d2e2eb77e5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:58.952794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84163-302a-413e-a36c-fe9443be8a8e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:58.953093 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84163-302a-413e-a36c-fe9443be8a8e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:58.953371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84163-302a-413e-a36c-fe9443be8a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:58.973770 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8ad84163-302a-413e-a36c-fe9443be8a8e None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:58.975039 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8ad84163-302a-413e-a36c-fe9443be8a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:59.005585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:59.042222 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1429/2841] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:59.052958 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86159be-020c-4439-a310-40667af13aa7 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.053709 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86159be-020c-4439-a310-40667af13aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.054200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86159be-020c-4439-a310-40667af13aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.078288 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-e86159be-020c-4439-a310-40667af13aa7 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:59.079536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e86159be-020c-4439-a310-40667af13aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:59.087610 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1413/2842] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:59.094462 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad84163-302a-413e-a36c-fe9443be8a8e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.108175 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad84163-302a-413e-a36c-fe9443be8a8e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:59.113328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:59.113950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.114232 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.114537 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.115194 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:40:59.115503 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:59.117160 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:59.131147 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1430/2843] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:40:59.136335 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86159be-020c-4439-a310-40667af13aa7 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.145650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86159be-020c-4439-a310-40667af13aa7 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:59.151006 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10769-b10f-4fb6-9ca4-abf41f45c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:59.151703 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10769-b10f-4fb6-9ca4-abf41f45c8ac admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.151908 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10769-b10f-4fb6-9ca4-abf41f45c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.152183 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10769-b10f-4fb6-9ca4-abf41f45c8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.152912 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb10769-b10f-4fb6-9ca4-abf41f45c8ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:59.154761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb10769-b10f-4fb6-9ca4-abf41f45c8ac admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:59.186431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1414/2844] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:59 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:40:59.190580 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.202470 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b12d01-0c44-4fca-b916-fc7fa514f6d8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:59.264380 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668e0ab-b4f4-46a3-9c9b-227f3f031ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:59.265004 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668e0ab-b4f4-46a3-9c9b-227f3f031ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.265289 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668e0ab-b4f4-46a3-9c9b-227f3f031ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.265567 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668e0ab-b4f4-46a3-9c9b-227f3f031ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.266485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668e0ab-b4f4-46a3-9c9b-227f3f031ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:59.268942 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668e0ab-b4f4-46a3-9c9b-227f3f031ac7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:59.292870 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1431/2845] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:59 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:59.297257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10769-b10f-4fb6-9ca4-abf41f45c8ac admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.309422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10769-b10f-4fb6-9ca4-abf41f45c8ac admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:59.314367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585a1a-b5c3-4e2d-838b-c962fcc07bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:59.314984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585a1a-b5c3-4e2d-838b-c962fcc07bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.315264 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585a1a-b5c3-4e2d-838b-c962fcc07bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.315539 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585a1a-b5c3-4e2d-838b-c962fcc07bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.316187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f585a1a-b5c3-4e2d-838b-c962fcc07bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:59.317775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f585a1a-b5c3-4e2d-838b-c962fcc07bc2 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:59.329201 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1415/2846] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:59.333405 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668e0ab-b4f4-46a3-9c9b-227f3f031ac7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.344172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668e0ab-b4f4-46a3-9c9b-227f3f031ac7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:59.348953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d309c-d718-4712-bd57-685629822148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:59.349559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d309c-d718-4712-bd57-685629822148 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.349838 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d309c-d718-4712-bd57-685629822148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.350116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d309c-d718-4712-bd57-685629822148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.350801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d309c-d718-4712-bd57-685629822148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:59.352428 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d309c-d718-4712-bd57-685629822148 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:59.365362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1432/2847] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:59.370589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585a1a-b5c3-4e2d-838b-c962fcc07bc2 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.387637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585a1a-b5c3-4e2d-838b-c962fcc07bc2 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:59.394757 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:59.395536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.395892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.396177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] PATH_INFO: `/v3/projects/747109ac31fd4814885c9d2502cc5227/users/34c1613d1a1a47f5b89033c9f98963cf/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.420739 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747109ac31fd4814885c9d2502cc5227, user_id=34c1613d1a1a47f5b89033c9f98963cf, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:59.423645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:59.443576 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1416/2848] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:59 2022] PUT /identity/v3/projects/747109ac31fd4814885c9d2502cc5227/users/34c1613d1a1a47f5b89033c9f98963cf/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:59.454950 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35b57-fe48-4504-8297-d5fd5c704c49 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.455176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35b57-fe48-4504-8297-d5fd5c704c49 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.455495 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f35b57-fe48-4504-8297-d5fd5c704c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.497263 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-67f35b57-fe48-4504-8297-d5fd5c704c49 None None] MFA Rules not processed for user `34c1613d1a1a47f5b89033c9f98963cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:59.498570 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-67f35b57-fe48-4504-8297-d5fd5c704c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:59.574948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1433/2849] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:40:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:59.586453 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.588773 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:59.662021 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186ed1-7af8-4dc6-946e-1c856f500076 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:59.665802 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190135f-7aca-47af-af45-02f449b89129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:59.667067 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190135f-7aca-47af-af45-02f449b89129 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.667349 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190135f-7aca-47af-af45-02f449b89129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.667625 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190135f-7aca-47af-af45-02f449b89129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.676968 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190135f-7aca-47af-af45-02f449b89129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:59.678624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190135f-7aca-47af-af45-02f449b89129 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:59.683903 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:59.689265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1417/2850] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:59.713521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f35b57-fe48-4504-8297-d5fd5c704c49 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.747427 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:59.789953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f35b57-fe48-4504-8297-d5fd5c704c49 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:59.798392 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:59.799107 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.799529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.799953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] PATH_INFO: `/v3/users/34c1613d1a1a47f5b89033c9f98963cf` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.801400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c1613d1a1a47f5b89033c9f98963cf)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:59.803406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:59.854998 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c1613d1a1a47f5b89033c9f98963cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:59.862750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c1613d1a1a47f5b89033c9f98963cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:59.863507 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c1613d1a1a47f5b89033c9f98963cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:59.871318 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c1613d1a1a47f5b89033c9f98963cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:59.871933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c1613d1a1a47f5b89033c9f98963cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:59.889977 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1434/2851] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:59 2022] DELETE /identity/v3/users/34c1613d1a1a47f5b89033c9f98963cf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:59.894579 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30210eac-57ee-405d-ab29-fbec3a8b6b1f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:59.894892 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30210eac-57ee-405d-ab29-fbec3a8b6b1f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:59.895165 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30210eac-57ee-405d-ab29-fbec3a8b6b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:59.917638 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-30210eac-57ee-405d-ab29-fbec3a8b6b1f None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:59.918925 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-30210eac-57ee-405d-ab29-fbec3a8b6b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:59.986714 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1418/2852] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:59.997047 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:59.998490 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:00.058995 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efebba-e8e7-4a22-a455-ce4c1de8091b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.063057 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea768729-da23-4f97-80c8-005bd9f9c2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.063735 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768729-da23-4f97-80c8-005bd9f9c2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.064026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768729-da23-4f97-80c8-005bd9f9c2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.064298 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea768729-da23-4f97-80c8-005bd9f9c2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.074756 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea768729-da23-4f97-80c8-005bd9f9c2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.076171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea768729-da23-4f97-80c8-005bd9f9c2f4 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.085401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1435/2853] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:00.355247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30210eac-57ee-405d-ab29-fbec3a8b6b1f None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:00.356640 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-30210eac-57ee-405d-ab29-fbec3a8b6b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:00.372542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30210eac-57ee-405d-ab29-fbec3a8b6b1f None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.377490 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.378127 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.378470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.378705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] PATH_INFO: `/v3/projects/747109ac31fd4814885c9d2502cc5227` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.380128 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=747109ac31fd4814885c9d2502cc5227)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.382734 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.441589 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747109ac31fd4814885c9d2502cc5227', 'request_id': 'req-c1e3adcc-07ef-4266-a708-32bc88a286eb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:00.454378 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747109ac31fd4814885c9d2502cc5227', 'request_id': 'req-c1e3adcc-07ef-4266-a708-32bc88a286eb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:00.465913 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747109ac31fd4814885c9d2502cc5227', 'request_id': 'req-c1e3adcc-07ef-4266-a708-32bc88a286eb'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:00.479293 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] The token cache is being invalidate because project 747109ac31fd4814885c9d2502cc5227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:00.479687 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:00.480387 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c1e3adcc-07ef-4266-a708-32bc88a286eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:00.481897 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1419/2854] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:00 2022] DELETE /identity/v3/projects/747109ac31fd4814885c9d2502cc5227 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:00.486827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234e08-9d6b-4733-a6b0-e10ecc98dafa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.487367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234e08-9d6b-4733-a6b0-e10ecc98dafa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.487367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234e08-9d6b-4733-a6b0-e10ecc98dafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.509912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c3234e08-9d6b-4733-a6b0-e10ecc98dafa None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:00.511823 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c3234e08-9d6b-4733-a6b0-e10ecc98dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:00.562727 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:00.582036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1436/2855] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:00.591876 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fa4d6-d5e7-4d6a-81d3-5f17e1461e87 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.592158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fa4d6-d5e7-4d6a-81d3-5f17e1461e87 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.592431 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fa4d6-d5e7-4d6a-81d3-5f17e1461e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.613312 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-0b6fa4d6-d5e7-4d6a-81d3-5f17e1461e87 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:00.614549 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-0b6fa4d6-d5e7-4d6a-81d3-5f17e1461e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:00.623500 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1420/2856] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:00.628215 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3234e08-9d6b-4733-a6b0-e10ecc98dafa None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:00.640205 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3234e08-9d6b-4733-a6b0-e10ecc98dafa None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.645142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.645767 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.646045 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.646400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.647060 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:41:00.647365 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.648969 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.662642 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1437/2857] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:41:00.667297 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fa4d6-d5e7-4d6a-81d3-5f17e1461e87 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:00.677123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fa4d6-d5e7-4d6a-81d3-5f17e1461e87 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.682368 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5579bc8-b11f-4e76-8c7c-47326b973bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.682979 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5579bc8-b11f-4e76-8c7c-47326b973bee admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.683257 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5579bc8-b11f-4e76-8c7c-47326b973bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.683534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5579bc8-b11f-4e76-8c7c-47326b973bee admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.684188 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5579bc8-b11f-4e76-8c7c-47326b973bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.686133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5579bc8-b11f-4e76-8c7c-47326b973bee admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.715717 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1421/2858] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:41:00 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:00.722724 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:00.733371 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216412c-51a2-4ae3-8df6-d031d09544cc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.793101 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd196d-9a68-4187-b061-964271c34ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.793801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd196d-9a68-4187-b061-964271c34ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.794126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd196d-9a68-4187-b061-964271c34ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.794482 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd196d-9a68-4187-b061-964271c34ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.795173 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd196d-9a68-4187-b061-964271c34ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.797293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd196d-9a68-4187-b061-964271c34ff8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.822900 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1438/2859] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:41:00 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:00.827238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5579bc8-b11f-4e76-8c7c-47326b973bee admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:00.837488 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5579bc8-b11f-4e76-8c7c-47326b973bee admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.842529 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924b514-61b9-4d78-a758-f90c65f963f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.843162 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924b514-61b9-4d78-a758-f90c65f963f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.843452 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924b514-61b9-4d78-a758-f90c65f963f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.843720 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924b514-61b9-4d78-a758-f90c65f963f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.844398 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924b514-61b9-4d78-a758-f90c65f963f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.845997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924b514-61b9-4d78-a758-f90c65f963f8 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.858376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1422/2860] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:00.862713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd196d-9a68-4187-b061-964271c34ff8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:00.874042 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd196d-9a68-4187-b061-964271c34ff8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.879525 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50930385-9aea-430f-8faa-89d7eaba9cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.880362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930385-9aea-430f-8faa-89d7eaba9cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.880748 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930385-9aea-430f-8faa-89d7eaba9cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.881096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930385-9aea-430f-8faa-89d7eaba9cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.881884 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50930385-9aea-430f-8faa-89d7eaba9cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.883883 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50930385-9aea-430f-8faa-89d7eaba9cf8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.898715 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1439/2861] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:00.902738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924b514-61b9-4d78-a758-f90c65f963f8 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:00.926570 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924b514-61b9-4d78-a758-f90c65f963f8 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.937208 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.938151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.938746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.939166 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] PATH_INFO: `/v3/projects/ca395881d89b4ab190b121570530d771/users/fd34aae0ecf44d7ab687c4696f3dccf5/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.963768 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca395881d89b4ab190b121570530d771, user_id=fd34aae0ecf44d7ab687c4696f3dccf5, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.966464 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.986917 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1423/2862] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:41:00 2022] PUT /identity/v3/projects/ca395881d89b4ab190b121570530d771/users/fd34aae0ecf44d7ab687c4696f3dccf5/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:01.000802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb4d2-94e5-477e-b80a-bd2b78bfe9f2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:01.001148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb4d2-94e5-477e-b80a-bd2b78bfe9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:01.001608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb4d2-94e5-477e-b80a-bd2b78bfe9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:01.038547 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-75feb4d2-94e5-477e-b80a-bd2b78bfe9f2 None None] MFA Rules not processed for user `fd34aae0ecf44d7ab687c4696f3dccf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:01.039791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-75feb4d2-94e5-477e-b80a-bd2b78bfe9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:01.127273 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1440/2863] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:01.192302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:01.192302 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:01.209182 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:01.251981 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2454ee-da74-47eb-b529-8089b4266ea6 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:01.256077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9eabe-2ede-477c-afcc-6585efa5b809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:01.256738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9eabe-2ede-477c-afcc-6585efa5b809 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:01.256982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9eabe-2ede-477c-afcc-6585efa5b809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:01.257228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9eabe-2ede-477c-afcc-6585efa5b809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:01.267322 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9eabe-2ede-477c-afcc-6585efa5b809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:01.268730 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9eabe-2ede-477c-afcc-6585efa5b809 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:01.279406 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1424/2864] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:41:01.299390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb4d2-94e5-477e-b80a-bd2b78bfe9f2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:01.370554 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:01.398783 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb4d2-94e5-477e-b80a-bd2b78bfe9f2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:01.406191 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:01.407116 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:01.407565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:01.407888 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] PATH_INFO: `/v3/users/fd34aae0ecf44d7ab687c4696f3dccf5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:01.409511 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd34aae0ecf44d7ab687c4696f3dccf5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:01.412028 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:01.486336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd34aae0ecf44d7ab687c4696f3dccf5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.497585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd34aae0ecf44d7ab687c4696f3dccf5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.497585 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd34aae0ecf44d7ab687c4696f3dccf5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.506822 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd34aae0ecf44d7ab687c4696f3dccf5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.507866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd34aae0ecf44d7ab687c4696f3dccf5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.529096 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1441/2865] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:41:01 2022] DELETE /identity/v3/users/fd34aae0ecf44d7ab687c4696f3dccf5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:01.534209 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567cb2f-dd7c-458a-a2ad-a2105008f627 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:01.534715 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567cb2f-dd7c-458a-a2ad-a2105008f627 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:01.534830 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567cb2f-dd7c-458a-a2ad-a2105008f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:01.555639 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-6567cb2f-dd7c-458a-a2ad-a2105008f627 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:01.556879 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6567cb2f-dd7c-458a-a2ad-a2105008f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:01.639053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1425/2866] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:01.649787 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:01.652761 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:01.731245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94723ef9-6046-4311-9aa2-f01ad320bce1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:01.735268 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1d7c2-534e-4d5e-bef1-e557b0465afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:01.736079 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d7c2-534e-4d5e-bef1-e557b0465afe service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:01.736364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d7c2-534e-4d5e-bef1-e557b0465afe service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:01.736814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d7c2-534e-4d5e-bef1-e557b0465afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:01.757453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1d7c2-534e-4d5e-bef1-e557b0465afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:01.759487 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1d7c2-534e-4d5e-bef1-e557b0465afe service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:01.771623 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1442/2867] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:02.157228 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567cb2f-dd7c-458a-a2ad-a2105008f627 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.158789 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6567cb2f-dd7c-458a-a2ad-a2105008f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:02.172907 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567cb2f-dd7c-458a-a2ad-a2105008f627 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.177700 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.178396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.178678 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.178960 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] PATH_INFO: `/v3/projects/ca395881d89b4ab190b121570530d771` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.180219 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca395881d89b4ab190b121570530d771)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.183213 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.253350 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca395881d89b4ab190b121570530d771', 'request_id': 'req-b609383f-43c4-4b5c-a633-3f83a927392a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.263154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca395881d89b4ab190b121570530d771', 'request_id': 'req-b609383f-43c4-4b5c-a633-3f83a927392a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.274932 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca395881d89b4ab190b121570530d771', 'request_id': 'req-b609383f-43c4-4b5c-a633-3f83a927392a'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.292327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] The token cache is being invalidate because project ca395881d89b4ab190b121570530d771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:02.293147 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.293890 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-b609383f-43c4-4b5c-a633-3f83a927392a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.295471 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1426/2868] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:02 2022] DELETE /identity/v3/projects/ca395881d89b4ab190b121570530d771 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:02.300890 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d3a98-3f8c-47ea-8b8b-b24a6d82c859 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.301172 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d3a98-3f8c-47ea-8b8b-b24a6d82c859 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.301448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d3a98-3f8c-47ea-8b8b-b24a6d82c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.329569 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-643d3a98-3f8c-47ea-8b8b-b24a6d82c859 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:02.332338 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-643d3a98-3f8c-47ea-8b8b-b24a6d82c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:02.433622 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1443/2869] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:02.445327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab00bb-1fc6-4c26-adcd-b96ff93d807c None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.445327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab00bb-1fc6-4c26-adcd-b96ff93d807c None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.446594 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab00bb-1fc6-4c26-adcd-b96ff93d807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.470251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-4bab00bb-1fc6-4c26-adcd-b96ff93d807c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:02.471473 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-4bab00bb-1fc6-4c26-adcd-b96ff93d807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:02.480216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1427/2870] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:02.484706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d3a98-3f8c-47ea-8b8b-b24a6d82c859 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.495359 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d3a98-3f8c-47ea-8b8b-b24a6d82c859 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.500083 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.500713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.501017 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.501291 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.501947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:41:02.502251 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.503931 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.505640 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:02.520066 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1444/2871] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:41:02.524395 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab00bb-1fc6-4c26-adcd-b96ff93d807c None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.534540 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab00bb-1fc6-4c26-adcd-b96ff93d807c None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.539419 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44f816-06da-45b8-b2dc-b1a1f3c78bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.540036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44f816-06da-45b8-b2dc-b1a1f3c78bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.540318 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44f816-06da-45b8-b2dc-b1a1f3c78bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.540580 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44f816-06da-45b8-b2dc-b1a1f3c78bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.541769 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44f816-06da-45b8-b2dc-b1a1f3c78bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.543705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44f816-06da-45b8-b2dc-b1a1f3c78bb0 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.580771 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1428/2872] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:41:02 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:02.585827 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.598139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160eef-96a5-4f27-83ba-e9a5b7bb9219 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.672485 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363998-9bbb-408b-91f8-41760c994d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.673150 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363998-9bbb-408b-91f8-41760c994d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.673434 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363998-9bbb-408b-91f8-41760c994d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.673713 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363998-9bbb-408b-91f8-41760c994d41 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.674404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10363998-9bbb-408b-91f8-41760c994d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.676394 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10363998-9bbb-408b-91f8-41760c994d41 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.701542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1445/2873] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:41:02 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:02.708805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44f816-06da-45b8-b2dc-b1a1f3c78bb0 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.725839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44f816-06da-45b8-b2dc-b1a1f3c78bb0 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.735014 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4428e-b798-4a35-be9d-c3bf39062589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.735869 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4428e-b798-4a35-be9d-c3bf39062589 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.736279 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4428e-b798-4a35-be9d-c3bf39062589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.736561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4428e-b798-4a35-be9d-c3bf39062589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.737408 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4428e-b798-4a35-be9d-c3bf39062589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.740430 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4428e-b798-4a35-be9d-c3bf39062589 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.761226 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1429/2874] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:02.765606 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363998-9bbb-408b-91f8-41760c994d41 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.783855 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363998-9bbb-408b-91f8-41760c994d41 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.792282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85325b-19e5-4c75-86f6-97ed902feb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.793255 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85325b-19e5-4c75-86f6-97ed902feb6f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.793662 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85325b-19e5-4c75-86f6-97ed902feb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.794121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85325b-19e5-4c75-86f6-97ed902feb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.795285 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85325b-19e5-4c75-86f6-97ed902feb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.797948 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85325b-19e5-4c75-86f6-97ed902feb6f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.818608 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1446/2875] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:02.823624 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4428e-b798-4a35-be9d-c3bf39062589 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.834197 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4428e-b798-4a35-be9d-c3bf39062589 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.840754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.841758 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.842110 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.842587 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] PATH_INFO: `/v3/projects/25b100830711488eaccc36e6452e393b/users/b3b80c8db57f466ab4260d2a2774d96c/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.846444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:02.867317 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b100830711488eaccc36e6452e393b, user_id=b3b80c8db57f466ab4260d2a2774d96c, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.870060 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.889779 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1430/2876] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:41:02 2022] PUT /identity/v3/projects/25b100830711488eaccc36e6452e393b/users/b3b80c8db57f466ab4260d2a2774d96c/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:41:02.896857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64b3e-acf9-42d9-8cfa-c253a102398c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.897176 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64b3e-acf9-42d9-8cfa-c253a102398c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.897455 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64b3e-acf9-42d9-8cfa-c253a102398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.926992 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ebc64b3e-acf9-42d9-8cfa-c253a102398c None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:02.928224 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ebc64b3e-acf9-42d9-8cfa-c253a102398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:03.018294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1447/2877] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:41:03.032766 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:03.035849 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:03.137888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082abc4-2f58-4fd1-9c3f-82ccc7174100 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:03.142194 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:03.142930 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.143263 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.143598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.158007 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:03.163875 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:03.175677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1431/2878] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:04.147240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1e7db-e83b-4908-b337-c6badb9cd892 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.148048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1e7db-e83b-4908-b337-c6badb9cd892 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.148181 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1e7db-e83b-4908-b337-c6badb9cd892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.185336 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-03f1e7db-e83b-4908-b337-c6badb9cd892 None None] MFA Rules not processed for user `b3b80c8db57f466ab4260d2a2774d96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:04.186654 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-03f1e7db-e83b-4908-b337-c6badb9cd892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:04.273947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1448/2879] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:04.285805 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:04.287478 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:04.376273 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0863-825c-445a-8117-11a7331b9348 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:04.380537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3397735-07bd-4607-ba4f-2831b2d66ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:04.381281 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397735-07bd-4607-ba4f-2831b2d66ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.381645 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397735-07bd-4607-ba4f-2831b2d66ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.382003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397735-07bd-4607-ba4f-2831b2d66ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.392151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3397735-07bd-4607-ba4f-2831b2d66ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:04.393612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3397735-07bd-4607-ba4f-2831b2d66ba9 service cinder] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:04.404220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1432/2880] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:05.894196 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71a73-4b7f-44d4-b09a-58cc06691c65 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:05.895020 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71a73-4b7f-44d4-b09a-58cc06691c65 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:05.895794 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71a73-4b7f-44d4-b09a-58cc06691c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:05.909230 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:05.934760 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-66c71a73-4b7f-44d4-b09a-58cc06691c65 None None] MFA Rules not processed for user `b3b80c8db57f466ab4260d2a2774d96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:05.936872 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-66c71a73-4b7f-44d4-b09a-58cc06691c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:05.950845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1449/2881] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:06.295266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3397735-07bd-4607-ba4f-2831b2d66ba9 service cinder] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:06.305723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3397735-07bd-4607-ba4f-2831b2d66ba9 service cinder] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:06.312474 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:06.314135 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:06.314486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:06.314772 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:06.316982 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:06.328807 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:06.330241 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:06.339388 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1433/2882] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:07.985111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c71a73-4b7f-44d4-b09a-58cc06691c65 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:07.986923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-66c71a73-4b7f-44d4-b09a-58cc06691c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:08.096383 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c71a73-4b7f-44d4-b09a-58cc06691c65 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:08.105056 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:08.106025 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:08.106475 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:08.106759 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:08.109164 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:08.129059 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:08.131706 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:08.149170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1450/2883] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:16.335028 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:18.141740 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=34 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:16.515641 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:45:16.517151 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:45:16.604301 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf5636-dd7e-43b3-b150-05e79aac747c service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:45:16.610997 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:45:16.611603 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:45:16.611889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:45:16.612170 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:45:16.613939 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:45:16.626537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:45:16.628113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:45:16.637813 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1434/2884] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:45:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:45:26.633631 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=37 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:45:52.318350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:45:52.356054 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a96c95-b6ba-4ee3-a295-ae4461db0be3 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:45:52.359771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:45:52.360389 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:45:52.360644 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:45:52.360915 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:45:52.362677 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:45:52.451559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:45:52.452987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:45:52.474390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1451/2885] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:45:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:45:53.578546 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:45:53.588124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b560-789c-44f5-84aa-1a44c049a7ed service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:45:53.591663 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:45:53.592256 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:45:53.592532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:45:53.592803 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:45:53.594543 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:45:53.608417 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:45:53.609836 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:45:53.621762 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1435/2886] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:45:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:46:02.471102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=58 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:03.616868 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:46:04.577401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:46:04.579011 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:46:04.593407 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5b5b-0c77-49d9-b6ff-aac1c98af458 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:46:04.599691 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb357c-4b7a-431e-adba-da3032e505b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:46:04.600287 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb357c-4b7a-431e-adba-da3032e505b7 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:46:04.600565 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb357c-4b7a-431e-adba-da3032e505b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:46:04.600840 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb357c-4b7a-431e-adba-da3032e505b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:46:04.608667 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb357c-4b7a-431e-adba-da3032e505b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:46:04.610225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb357c-4b7a-431e-adba-da3032e505b7 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:46:04.619064 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1452/2887] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:46:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:46:14.615250 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:08.878711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:47:08.889882 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef37cf5-1cbe-4bb7-8c85-afe6fc2be25e service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:47:08.895382 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:47:08.895985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:47:08.896266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:47:08.896537 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:47:08.898251 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:47:08.909445 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:47:08.911632 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:47:08.921247 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1436/2888] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:47:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:47:09.080208 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c401b-9809-4036-9255-b3533afd3e92 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:47:09.080750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c401b-9809-4036-9255-b3533afd3e92 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:47:09.080750 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c401b-9809-4036-9255-b3533afd3e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:47:09.101367 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ad7c401b-9809-4036-9255-b3533afd3e92 None None] MFA Rules not processed for user `b3b80c8db57f466ab4260d2a2774d96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:47:09.102601 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ad7c401b-9809-4036-9255-b3533afd3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:47:09.109587 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1453/2889] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:47:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:47:09.341000 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:47:09.350902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f39c5-02bc-410f-82fd-86b8b9f90247 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:47:09.354361 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:47:09.354940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:47:09.355220 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:47:09.355489 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:47:09.357223 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:47:09.379794 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:47:09.381259 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:47:09.389087 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1437/2890] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:47:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:47:09.715170 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c401b-9809-4036-9255-b3533afd3e92 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:47:09.727817 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c401b-9809-4036-9255-b3533afd3e92 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:47:09.732789 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b1266-acf0-4c8a-9a28-67e02003cc7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:47:09.733429 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1266-acf0-4c8a-9a28-67e02003cc7d service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:47:09.733716 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1266-acf0-4c8a-9a28-67e02003cc7d service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:47:09.734076 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1266-acf0-4c8a-9a28-67e02003cc7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:47:09.744031 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b1266-acf0-4c8a-9a28-67e02003cc7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:47:09.745625 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b1266-acf0-4c8a-9a28-67e02003cc7d service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:47:09.756799 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1454/2891] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:47:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:47:19.385532 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=17 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:47:19.751647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=9 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:20.508077 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:50:20.520056 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fee09-f48c-4f24-8ab4-8b85d694f072 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:50:20.525016 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d6da-d79c-4fa5-ace5-bb273a1c36ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:50:20.525606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d6da-d79c-4fa5-ace5-bb273a1c36ca service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:50:20.525885 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d6da-d79c-4fa5-ace5-bb273a1c36ca service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:50:20.526158 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d6da-d79c-4fa5-ace5-bb273a1c36ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:50:20.534454 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375d6da-d79c-4fa5-ace5-bb273a1c36ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:50:20.536022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375d6da-d79c-4fa5-ace5-bb273a1c36ca service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:50:20.546492 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1438/2892] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:50:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:50:30.542109 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:50:53.005564 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b1266-acf0-4c8a-9a28-67e02003cc7d service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:50:53.015663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b1266-acf0-4c8a-9a28-67e02003cc7d service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:50:53.019282 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c9189-5115-4686-8823-4271b92b9111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:50:53.019876 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9189-5115-4686-8823-4271b92b9111 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:50:53.020156 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9189-5115-4686-8823-4271b92b9111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:50:53.020447 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9189-5115-4686-8823-4271b92b9111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:50:53.031390 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c9189-5115-4686-8823-4271b92b9111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:50:53.032802 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c9189-5115-4686-8823-4271b92b9111 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:50:53.043832 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1455/2893] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:50:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:50:54.148200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d6da-d79c-4fa5-ace5-bb273a1c36ca service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:50:54.157438 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d6da-d79c-4fa5-ace5-bb273a1c36ca service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:50:54.161036 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61971cf1-1122-4b96-94d1-241757b24ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:50:54.161621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61971cf1-1122-4b96-94d1-241757b24ade service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:50:54.161902 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61971cf1-1122-4b96-94d1-241757b24ade service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:50:54.162175 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61971cf1-1122-4b96-94d1-241757b24ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:50:54.172888 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61971cf1-1122-4b96-94d1-241757b24ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:50:54.174327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61971cf1-1122-4b96-94d1-241757b24ade service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:50:54.185858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1439/2894] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:50:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:51:03.039063 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:04.180862 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:51:05.133812 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c9189-5115-4686-8823-4271b92b9111 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:51:05.144982 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c9189-5115-4686-8823-4271b92b9111 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:51:05.150529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b95608-2c7f-4988-8a89-1b7423c7fc95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:51:05.151122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95608-2c7f-4988-8a89-1b7423c7fc95 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:51:05.151404 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95608-2c7f-4988-8a89-1b7423c7fc95 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:51:05.151678 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b95608-2c7f-4988-8a89-1b7423c7fc95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:51:05.153473 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-89b95608-2c7f-4988-8a89-1b7423c7fc95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:51:05.230805 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95608-2c7f-4988-8a89-1b7423c7fc95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:51:05.232381 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b95608-2c7f-4988-8a89-1b7423c7fc95 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:51:05.250529 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1456/2895] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:51:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:51:15.247947 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=41 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:09.807258 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61971cf1-1122-4b96-94d1-241757b24ade service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:09.876003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61971cf1-1122-4b96-94d1-241757b24ade service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:09.881046 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:09.882412 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:09.882853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:09.883137 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:09.884893 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:09.895984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:09.897796 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:09.907376 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1440/2896] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:53:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:53:14.773533 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f09fb-d3a1-401a-8fce-6282c8682a6c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:14.774038 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f09fb-d3a1-401a-8fce-6282c8682a6c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:14.774135 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f09fb-d3a1-401a-8fce-6282c8682a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:14.835198 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-044f09fb-d3a1-401a-8fce-6282c8682a6c None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:53:14.836457 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-044f09fb-d3a1-401a-8fce-6282c8682a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:14.904112 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1457/2897] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 08:53:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:53:14.958205 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:14.960168 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:15.050808 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade34d-e805-4ad0-93e9-50c14be6a7e5 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:15.056216 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243d1d-90aa-4dc4-97d4-f8487831c333 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:15.056817 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243d1d-90aa-4dc4-97d4-f8487831c333 service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:15.057098 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243d1d-90aa-4dc4-97d4-f8487831c333 service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:15.057375 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243d1d-90aa-4dc4-97d4-f8487831c333 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:15.065342 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6243d1d-90aa-4dc4-97d4-f8487831c333 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:15.066963 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6243d1d-90aa-4dc4-97d4-f8487831c333 service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:15.075019 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1441/2898] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:53:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:53:24.901267 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=44 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:25.071838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=73 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:31.368043 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0cc6a-086f-44d1-9030-e463c48dcc45 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:31.368990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0cc6a-086f-44d1-9030-e463c48dcc45 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:31.368990 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0cc6a-086f-44d1-9030-e463c48dcc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:31.388264 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-88d0cc6a-086f-44d1-9030-e463c48dcc45 None None] MFA Rules not processed for user `57b1ae1f4f4e4f199a3798a4ff0b83c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:53:31.389453 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-88d0cc6a-086f-44d1-9030-e463c48dcc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:31.397342 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1458/2899] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:53:31.409621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243d1d-90aa-4dc4-97d4-f8487831c333 service swift] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:31.420606 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243d1d-90aa-4dc4-97d4-f8487831c333 service swift] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:31.425475 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9aa824aafe4c499df84fa0c3fe3f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:31.426061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:31.426363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:31.426634 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:31.434992 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:31.436598 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:31.444999 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1442/2900] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 08:53:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:53:32.836846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0cc6a-086f-44d1-9030-e463c48dcc45 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:32.838448 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-88d0cc6a-086f-44d1-9030-e463c48dcc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:32.892026 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0cc6a-086f-44d1-9030-e463c48dcc45 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:32.895526 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:32.896121 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:32.896917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:32.897190 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:32.898987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:32.980801 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:32.982235 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:33.000210 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1459/2901] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:53:33.607154 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:33.608819 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:33.623853 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a058f-ff13-4106-89f1-330273d17d70 service swift] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:33.628855 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:33.629389 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:33.629671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:33.629952 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:33.632391 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:33.645083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:33.646847 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:33.658536 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1443/2902] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:53:33.661436 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:33.663293 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:33.675768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629409e6-78d7-47c6-b7ac-e239cb4b845f service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:33.681559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:33.682300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:33.682499 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:33.682775 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] PATH_INFO: `/v3/users/b3b80c8db57f466ab4260d2a2774d96c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:33.683885 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b80c8db57f466ab4260d2a2774d96c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:33.685788 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:33.733771 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b80c8db57f466ab4260d2a2774d96c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:33.741260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b80c8db57f466ab4260d2a2774d96c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:33.741923 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b80c8db57f466ab4260d2a2774d96c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:33.749681 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b80c8db57f466ab4260d2a2774d96c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:33.750406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d704dce8-b5e5-4eb9-a985-5c228485058f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b80c8db57f466ab4260d2a2774d96c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:33.755581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:33.769868 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1460/2903] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 08:53:33 2022] DELETE /identity/v3/users/b3b80c8db57f466ab4260d2a2774d96c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:53:33.944001 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:33.954765 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f5af-0f3c-42dc-b722-87ad1bf7248b service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:34.013310 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:34.013955 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.014239 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.014544 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] PATH_INFO: `/v3/projects/25b100830711488eaccc36e6452e393b` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.015701 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b100830711488eaccc36e6452e393b)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:34.017612 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:34.062937 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b100830711488eaccc36e6452e393b', 'request_id': 'req-dcb599d6-5dfb-4f86-b01d-831c61a42cff'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:34.069507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b100830711488eaccc36e6452e393b', 'request_id': 'req-dcb599d6-5dfb-4f86-b01d-831c61a42cff'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:34.076672 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b100830711488eaccc36e6452e393b', 'request_id': 'req-dcb599d6-5dfb-4f86-b01d-831c61a42cff'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:34.087670 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] The token cache is being invalidate because project 25b100830711488eaccc36e6452e393b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:53:34.087961 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:34.088585 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-dcb599d6-5dfb-4f86-b01d-831c61a42cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:53:34.090031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1444/2904] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 08:53:33 2022] DELETE /identity/v3/projects/25b100830711488eaccc36e6452e393b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:53:34.094937 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68743492-d28a-41de-ba27-586734796780 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.095410 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68743492-d28a-41de-ba27-586734796780 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.095521 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68743492-d28a-41de-ba27-586734796780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.153406 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-68743492-d28a-41de-ba27-586734796780 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:53:34.154581 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-68743492-d28a-41de-ba27-586734796780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:34.215419 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1461/2905] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:53:34.223031 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15381-5158-4097-95ef-e1e9d9aab912 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.223323 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15381-5158-4097-95ef-e1e9d9aab912 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.223602 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15381-5158-4097-95ef-e1e9d9aab912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.244363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-86f15381-5158-4097-95ef-e1e9d9aab912 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:53:34.245569 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-86f15381-5158-4097-95ef-e1e9d9aab912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:34.253364 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1445/2906] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:53:34.257549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68743492-d28a-41de-ba27-586734796780 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:34.267144 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68743492-d28a-41de-ba27-586734796780 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:34.272168 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:34.272769 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.273048 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.273320 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.273954 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:53:34.274276 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:34.275867 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:34.287649 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1462/2907] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 08:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:53:34.291889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15381-5158-4097-95ef-e1e9d9aab912 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:34.301093 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15381-5158-4097-95ef-e1e9d9aab912 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:34.306092 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819bd7-8d99-4492-92e5-b339f387d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:34.306713 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819bd7-8d99-4492-92e5-b339f387d92b admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.306986 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819bd7-8d99-4492-92e5-b339f387d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.307499 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819bd7-8d99-4492-92e5-b339f387d92b admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.308124 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22819bd7-8d99-4492-92e5-b339f387d92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:34.309985 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22819bd7-8d99-4492-92e5-b339f387d92b admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:34.345984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1446/2908] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:53:34 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:53:34.350930 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:34.360652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aba622-31da-47e4-835f-27364c3de758 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:34.417245 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f317f2-b3e6-4818-876f-0c1e0e197be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:34.417774 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f317f2-b3e6-4818-876f-0c1e0e197be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.418055 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f317f2-b3e6-4818-876f-0c1e0e197be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.418357 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f317f2-b3e6-4818-876f-0c1e0e197be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.418985 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f317f2-b3e6-4818-876f-0c1e0e197be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:34.420878 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f317f2-b3e6-4818-876f-0c1e0e197be1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:34.442167 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1463/2909] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:53:34 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:53:34.446870 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819bd7-8d99-4492-92e5-b339f387d92b admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:34.457187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819bd7-8d99-4492-92e5-b339f387d92b admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:34.461887 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6f0e-0b1a-41ca-b7d2-37b12cba0f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:34.462526 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6f0e-0b1a-41ca-b7d2-37b12cba0f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.462836 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6f0e-0b1a-41ca-b7d2-37b12cba0f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.463116 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6f0e-0b1a-41ca-b7d2-37b12cba0f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.463751 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d6f0e-0b1a-41ca-b7d2-37b12cba0f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:34.465363 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d6f0e-0b1a-41ca-b7d2-37b12cba0f99 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:34.475416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1447/2910] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:53:34.479294 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f317f2-b3e6-4818-876f-0c1e0e197be1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:34.489105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f317f2-b3e6-4818-876f-0c1e0e197be1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:34.494169 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5a43f-42d5-48a9-8119-ffa84b248411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:34.494791 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a43f-42d5-48a9-8119-ffa84b248411 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.495070 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a43f-42d5-48a9-8119-ffa84b248411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.495344 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5a43f-42d5-48a9-8119-ffa84b248411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.495975 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a43f-42d5-48a9-8119-ffa84b248411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:34.497549 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5a43f-42d5-48a9-8119-ffa84b248411 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:34.509873 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1464/2911] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:53:34.513801 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6f0e-0b1a-41ca-b7d2-37b12cba0f99 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:34.523946 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6f0e-0b1a-41ca-b7d2-37b12cba0f99 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:34.528705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:34.529345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.529627 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.529900 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] PATH_INFO: `/v3/projects/080a584184d2447bad65232e948ee0e0/users/3979dd9da28948c584d0eabbc7ef9559/roles/af32346e85724870afa2c6aee5b285ed` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.543262 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:34.546507 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080a584184d2447bad65232e948ee0e0, user_id=3979dd9da28948c584d0eabbc7ef9559, role_id=af32346e85724870afa2c6aee5b285ed)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:34.550061 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:34.564311 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1448/2912] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:53:34 2022] PUT /identity/v3/projects/080a584184d2447bad65232e948ee0e0/users/3979dd9da28948c584d0eabbc7ef9559/roles/af32346e85724870afa2c6aee5b285ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:53:34.570226 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dedd0-8fe8-48d8-a3e8-dd4e9a296113 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.570542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dedd0-8fe8-48d8-a3e8-dd4e9a296113 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.570824 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dedd0-8fe8-48d8-a3e8-dd4e9a296113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.589643 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7d9dedd0-8fe8-48d8-a3e8-dd4e9a296113 None None] MFA Rules not processed for user `d2d8becce6b1469fa561088c062a1608`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:53:34.590877 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7d9dedd0-8fe8-48d8-a3e8-dd4e9a296113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:34.607193 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:34.651685 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1465/2913] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:53:34.661233 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:34.663535 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:34.719155 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19464d7-7dba-4984-92c8-78e56f4a65f7 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:34.722760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1eca0-b10c-409e-bf87-973d72471a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:34.723367 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1eca0-b10c-409e-bf87-973d72471a47 service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:34.723650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1eca0-b10c-409e-bf87-973d72471a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:34.723924 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1eca0-b10c-409e-bf87-973d72471a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:34.733252 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1eca0-b10c-409e-bf87-973d72471a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:34.734705 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1eca0-b10c-409e-bf87-973d72471a47 service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:34.744688 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1449/2914] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:53:38.530532 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0cec0-8222-45c9-8fff-188a41983e20 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:38.531036 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0cec0-8222-45c9-8fff-188a41983e20 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:38.531122 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0cec0-8222-45c9-8fff-188a41983e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:38.561519 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-42d0cec0-8222-45c9-8fff-188a41983e20 None None] MFA Rules not processed for user `3979dd9da28948c584d0eabbc7ef9559`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:53:38.562711 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-42d0cec0-8222-45c9-8fff-188a41983e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:38.636668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1466/2915] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:53:38.641146 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1eca0-b10c-409e-bf87-973d72471a47 service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:38.651983 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1eca0-b10c-409e-bf87-973d72471a47 service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:38.656548 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4472d8-3baf-4071-bd8a-dabb48843520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:38.657149 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4472d8-3baf-4071-bd8a-dabb48843520 admin admin] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:38.657432 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4472d8-3baf-4071-bd8a-dabb48843520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:38.657725 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4472d8-3baf-4071-bd8a-dabb48843520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:38.658360 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4472d8-3baf-4071-bd8a-dabb48843520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:38.660234 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4472d8-3baf-4071-bd8a-dabb48843520 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:38.690397 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1450/2916] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 08:53:38 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:53:38.697726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0cec0-8222-45c9-8fff-188a41983e20 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:38.710865 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0cec0-8222-45c9-8fff-188a41983e20 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:38.775596 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80294632-2bef-4ce1-abbe-a876a9ffd67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:38.776204 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294632-2bef-4ce1-abbe-a876a9ffd67e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:38.776492 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294632-2bef-4ce1-abbe-a876a9ffd67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:38.776768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294632-2bef-4ce1-abbe-a876a9ffd67e admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:38.777400 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80294632-2bef-4ce1-abbe-a876a9ffd67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:38.779397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80294632-2bef-4ce1-abbe-a876a9ffd67e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:38.802397 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1467/2917] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 08:53:38 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:53:38.806723 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4472d8-3baf-4071-bd8a-dabb48843520 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:38.818623 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4472d8-3baf-4071-bd8a-dabb48843520 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:38.824187 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922d79c-19d4-4ba1-a294-1d90202fb14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:38.824809 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922d79c-19d4-4ba1-a294-1d90202fb14c admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:38.825090 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922d79c-19d4-4ba1-a294-1d90202fb14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:38.825365 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922d79c-19d4-4ba1-a294-1d90202fb14c admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:38.826037 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922d79c-19d4-4ba1-a294-1d90202fb14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:38.827666 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922d79c-19d4-4ba1-a294-1d90202fb14c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:38.841040 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1451/2918] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:53:38.844917 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80294632-2bef-4ce1-abbe-a876a9ffd67e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:38.861652 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80294632-2bef-4ce1-abbe-a876a9ffd67e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:38.881544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439b6f-04c1-4799-8ce1-59594f383037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:38.882225 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439b6f-04c1-4799-8ce1-59594f383037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:38.882674 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439b6f-04c1-4799-8ce1-59594f383037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:38.882956 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d439b6f-04c1-4799-8ce1-59594f383037 admin admin] PATH_INFO: `/v3/projects/c5638b9130254e2ba002557667739a0f/users/77920909966f43c2b8b954064b2f5e2b/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:38.898892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d439b6f-04c1-4799-8ce1-59594f383037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5638b9130254e2ba002557667739a0f, user_id=77920909966f43c2b8b954064b2f5e2b, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:38.901518 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d439b6f-04c1-4799-8ce1-59594f383037 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:38.920217 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1468/2919] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:53:38 2022] PUT /identity/v3/projects/c5638b9130254e2ba002557667739a0f/users/77920909966f43c2b8b954064b2f5e2b/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:53:38.924139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922d79c-19d4-4ba1-a294-1d90202fb14c admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:38.934711 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922d79c-19d4-4ba1-a294-1d90202fb14c admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:38.999308 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b227-4a36-483c-b5ef-b064741ef0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:38.999920 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b227-4a36-483c-b5ef-b064741ef0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:39.000203 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b227-4a36-483c-b5ef-b064741ef0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:39.000482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b227-4a36-483c-b5ef-b064741ef0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:39.001133 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b227-4a36-483c-b5ef-b064741ef0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:39.002761 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b227-4a36-483c-b5ef-b064741ef0eb admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:39.013858 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1452/2920] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:53:39.017904 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439b6f-04c1-4799-8ce1-59594f383037 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:39.028986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d439b6f-04c1-4799-8ce1-59594f383037 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:39.033666 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:39.034378 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:39.034663 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:39.034936 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] PATH_INFO: `/v3/projects/c5638b9130254e2ba002557667739a0f/users/77920909966f43c2b8b954064b2f5e2b/roles/b76f0bbd02794923b10af161becac1c6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:39.036961 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5638b9130254e2ba002557667739a0f, user_id=77920909966f43c2b8b954064b2f5e2b, role_id=b76f0bbd02794923b10af161becac1c6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:39.039668 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:39.050820 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1469/2921] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 08:53:39 2022] PUT /identity/v3/projects/c5638b9130254e2ba002557667739a0f/users/77920909966f43c2b8b954064b2f5e2b/roles/b76f0bbd02794923b10af161becac1c6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:53:43.387051 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fade2-7bb6-40ec-999f-34f6519c846f None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:43.387542 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fade2-7bb6-40ec-999f-34f6519c846f None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:43.387619 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fade2-7bb6-40ec-999f-34f6519c846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:43.416134 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-b68fade2-7bb6-40ec-999f-34f6519c846f None None] MFA Rules not processed for user `77920909966f43c2b8b954064b2f5e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:53:43.417266 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-b68fade2-7bb6-40ec-999f-34f6519c846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:43.477444 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:43.514314 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1453/2922] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:53:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:53:43.530319 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:43.532544 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:43.542530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:43.625364 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e1efc-ea81-4177-9932-a36d8564910b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:43.633768 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d1d2d-a35b-4f3e-9c29-92aa48920f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:43.634559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d1d2d-a35b-4f3e-9c29-92aa48920f61 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:43.634846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d1d2d-a35b-4f3e-9c29-92aa48920f61 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:43.635124 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d1d2d-a35b-4f3e-9c29-92aa48920f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:43.703958 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d1d2d-a35b-4f3e-9c29-92aa48920f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:43.705542 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d1d2d-a35b-4f3e-9c29-92aa48920f61 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:43.732879 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1470/2923] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:53:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:53:53.511139 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=8 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:53.713946 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=54 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:53:58.960940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba39a89-1db5-482c-97fb-ca5f42b872e8 None None] REQUEST_METHOD: `POST` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:58.961422 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba39a89-1db5-482c-97fb-ca5f42b872e8 None None] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:58.961517 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba39a89-1db5-482c-97fb-ca5f42b872e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:58.980407 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.auth.core [None req-8ba39a89-1db5-482c-97fb-ca5f42b872e8 None None] MFA Rules not processed for user `3979dd9da28948c584d0eabbc7ef9559`. Rule list: `[]` (Enabled: `True`). {{(pid=81701) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:53:58.981590 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8ba39a89-1db5-482c-97fb-ca5f42b872e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:58.988433 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1454/2924] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:53:59.302647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d1d2d-a35b-4f3e-9c29-92aa48920f61 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:59.357328 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d1d2d-a35b-4f3e-9c29-92aa48920f61 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:59.361278 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:59.361825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:59.362111 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:59.362430 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:59.364143 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:59.374218 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:59.375688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:59.383576 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1471/2925] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:53:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:53:59.824840 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba39a89-1db5-482c-97fb-ca5f42b872e8 None None] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:53:59.826282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8ba39a89-1db5-482c-97fb-ca5f42b872e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:59.899552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba39a89-1db5-482c-97fb-ca5f42b872e8 None None] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:53:59.904650 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:53:59.905283 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:53:59.905561 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:53:59.905839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:53:59.907621 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:53:59.919511 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:53:59.921048 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:53:59.931015 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1455/2926] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:53:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:54:09.380081 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=26 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:54:09.926439 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=35 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:23.483474 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:55:23.527103 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1e556-9623-4454-a784-4c5417143bf5 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:55:23.532102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:55:23.532699 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:55:23.532986 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:55:23.533261 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:55:23.535001 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:55:23.568559 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:55:23.570933 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:55:23.580704 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1472/2927] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:55:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:55:33.576530 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=28 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:55:53.095501 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:55:53.132940 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4330c-18f1-4dc0-b85e-6391457ae05e service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:55:53.136785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:55:53.137385 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:55:53.137667 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:55:53.137944 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:55:53.139697 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:55:53.174082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:55:53.175498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:55:53.197534 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1456/2928] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:55:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:55:54.303094 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:55:54.322673 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a5936-2bf0-464b-80b8-196a1f44e494 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:55:54.326242 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:55:54.326857 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:55:54.327139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:55:54.327413 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:55:54.329105 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:55:54.342869 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:55:54.344280 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:55:54.355212 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1473/2929] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:55:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:56:03.194820 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=30 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:56:04.350139 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=11 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:58:43.428984 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:58:43.440282 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50345450-e50b-4986-a41e-39ece4ee26ed service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:58:43.446515 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26075ef4-c3e8-4ace-ba83-96d5789cfc81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7949d9285d4e4c908c377a0ac16dd14d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:58:43.447113 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075ef4-c3e8-4ace-ba83-96d5789cfc81 service nova] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:58:43.447396 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075ef4-c3e8-4ace-ba83-96d5789cfc81 service nova] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:58:43.447671 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26075ef4-c3e8-4ace-ba83-96d5789cfc81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:58:43.455538 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26075ef4-c3e8-4ace-ba83-96d5789cfc81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:58:43.457192 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26075ef4-c3e8-4ace-ba83-96d5789cfc81 service nova] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:58:43.466498 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1457/2930] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:58:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:58:53.462754 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:59:59.657670 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:59:59.659102 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:59:59.673350 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdce68-044d-45b1-bf43-1ac81cab7c11 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:59:59.678352 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:59:59.678953 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:59:59.679237 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:59:59.679512 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:59:59.681182 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:59:59.694656 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:59:59.696236 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:59:59.706983 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1474/2931] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 08:59:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 09:00:09.702825 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:00:26.463177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26075ef4-c3e8-4ace-ba83-96d5789cfc81 service nova] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:00:26.474552 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26075ef4-c3e8-4ace-ba83-96d5789cfc81 service nova] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:00:26.479416 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:00:26.480003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:00:26.480309 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:00:26.480746 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:00:26.489238 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:00:26.490865 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:00:26.501083 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1458/2932] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 09:00:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 09:00:36.496265 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=6 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:03:42.999752 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:03:43.001153 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:03:43.081597 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706bf8-34fd-438f-af23-2fc91e12c921 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:03:43.085240 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6ad1-b803-44a9-8a4a-2410b47ea2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c37ab868df74cd5a36323f7db5699d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:03:43.085844 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ad1-b803-44a9-8a4a-2410b47ea2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:03:43.086126 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ad1-b803-44a9-8a4a-2410b47ea2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:03:43.086441 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6ad1-b803-44a9-8a4a-2410b47ea2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:03:43.088227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e16f6ad1-b803-44a9-8a4a-2410b47ea2f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:03:43.120893 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6ad1-b803-44a9-8a4a-2410b47ea2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:03:43.122348 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6ad1-b803-44a9-8a4a-2410b47ea2f2 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:03:43.140171 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1475/2933] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 09:03:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 09:03:53.137637 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=48 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:05:30.475839 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:05:30.477423 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:05:30.599199 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6555038-2201-40ef-9cfc-6b7ddc2bb1d1 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:05:30.604190 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:05:30.604790 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:05:30.605073 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:05:30.605345 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:05:30.607200 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:05:30.618449 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:05:30.620003 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:05:30.630280 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1459/2934] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 09:05:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 09:05:40.626082 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=54 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:05:59.874080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba88c-40dc-4ce2-943c-fd593e4253e8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:05:59.874647 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba88c-40dc-4ce2-943c-fd593e4253e8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:05:59.874845 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ba88c-40dc-4ce2-943c-fd593e4253e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:05:59.946813 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-351ba88c-40dc-4ce2-943c-fd593e4253e8 None None] MFA Rules not processed for user `af3eef42cf30440aaf30f3ddb882fd04`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 09:05:59.948010 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-351ba88c-40dc-4ce2-943c-fd593e4253e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:06:00.030981 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1476/2935] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Sep 1 09:05:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 09:06:00.036851 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:06:00.056661 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e260ff-8498-44fd-a004-f3236641bff6 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:06:00.060156 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af3eef42cf30440aaf30f3ddb882fd04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:06:00.060775 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:06:00.061053 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:06:00.061327 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:06:00.063173 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:06:00.143566 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:06:00.144975 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:06:00.163436 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1460/2936] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 09:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 09:06:03.072493 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba88c-40dc-4ce2-943c-fd593e4253e8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:06:03.092803 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ba88c-40dc-4ce2-943c-fd593e4253e8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:06:03.098456 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:06:03.099077 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:06:03.099409 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:06:03.099688 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:06:03.101401 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:06:03.114726 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:06:03.116362 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:06:03.128960 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1477/2937] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 09:06:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 09:06:06.191476 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:06:06.203277 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37e29d-e4a6-44e9-bb6f-191e943bb1fe service neutron] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:06:06.210956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61c0e264e31845b9811944ba6cf976be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '043bbb7e8876497ebf1a84cc504aaff1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:06:06.211710 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] REQUEST_METHOD: `GET` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:06:06.211996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:06:06.212760 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:06:06.214482 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:06:06.232987 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:06:06.235911 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:06:06.246119 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:06:06.247866 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:06:06.258996 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1461/2938] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 09:06:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 09:06:06.262851 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dcff8-ece2-4426-a3fe-e8280488d270 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:06:06.273154 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:06:06.273557 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:06:06.273846 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:06:06.274123 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] PATH_INFO: `/v3/users/3979dd9da28948c584d0eabbc7ef9559` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:06:06.275300 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3979dd9da28948c584d0eabbc7ef9559)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:06:06.277366 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:06:06.333592 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3979dd9da28948c584d0eabbc7ef9559'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.341080 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3979dd9da28948c584d0eabbc7ef9559'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.341814 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3979dd9da28948c584d0eabbc7ef9559'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.349612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3979dd9da28948c584d0eabbc7ef9559'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.350227 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3979dd9da28948c584d0eabbc7ef9559'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.363612 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:06:06.369322 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1478/2939] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 09:06:06 2022] DELETE /identity/v3/users/3979dd9da28948c584d0eabbc7ef9559 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 09:06:06.683333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:06:06.696637 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875bb1b-3493-4d35-a29a-60834eca1685 service placement] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:06:06.753212 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:06:06.753825 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:06:06.754104 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:06:06.754413 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] PATH_INFO: `/v3/projects/080a584184d2447bad65232e948ee0e0` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:06:06.755508 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080a584184d2447bad65232e948ee0e0)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:06:06.757379 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:06:06.800420 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:06:06.805004 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080a584184d2447bad65232e948ee0e0', 'request_id': 'req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.812164 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080a584184d2447bad65232e948ee0e0', 'request_id': 'req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.819294 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080a584184d2447bad65232e948ee0e0', 'request_id': 'req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.830486 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] The token cache is being invalidate because project 080a584184d2447bad65232e948ee0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 09:06:06.830785 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.831470 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.832965 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1462/2940] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 09:06:06 2022] DELETE /identity/v3/projects/080a584184d2447bad65232e948ee0e0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 09:06:06.837058 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:06:06.838513 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:06:06.851892 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4bbe-c724-4811-ae38-f6859ed46c60 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:06:06.910049 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:06:06.910702 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:06:06.910987 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:06:06.911260 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] PATH_INFO: `/v3/users/77920909966f43c2b8b954064b2f5e2b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:06:06.923912 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77920909966f43c2b8b954064b2f5e2b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:06:06.925816 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:06:06.970142 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77920909966f43c2b8b954064b2f5e2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.976974 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77920909966f43c2b8b954064b2f5e2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.977614 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77920909966f43c2b8b954064b2f5e2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.985090 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77920909966f43c2b8b954064b2f5e2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:06.985811 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f83bbf81-46a4-44d3-bb05-6f35d233ef7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77920909966f43c2b8b954064b2f5e2b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:07.003148 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1479/2941] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 09:06:06 2022] DELETE /identity/v3/users/77920909966f43c2b8b954064b2f5e2b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 09:06:07.180123 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] Authenticating user token {{(pid=81701) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 09:06:07.182115 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.fernet_utils [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81701) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 09:06:07.197427 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2330e-4298-4f8f-ab2f-bd79c5890e12 admin admin] Validating token access rules against request {{(pid=81701) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 09:06:07.254738 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2d8becce6b1469fa561088c062a1608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41333422ff5e4255bb6c2174f444b692', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81701) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 09:06:07.255366 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 09:06:07.255677 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 09:06:07.255956 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] PATH_INFO: `/v3/projects/c5638b9130254e2ba002557667739a0f` {{(pid=81701) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 09:06:07.266100 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5638b9130254e2ba002557667739a0f)` {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 09:06:07.268022 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] RBAC: Authorization granted {{(pid=81701) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 09:06:07.313076 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5638b9130254e2ba002557667739a0f', 'request_id': 'req-a1723912-3d4c-4615-9761-42a54433c78c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:07.319613 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5638b9130254e2ba002557667739a0f', 'request_id': 'req-a1723912-3d4c-4615-9761-42a54433c78c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:07.326377 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5638b9130254e2ba002557667739a0f', 'request_id': 'req-a1723912-3d4c-4615-9761-42a54433c78c'} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:07.336889 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] The token cache is being invalidate because project c5638b9130254e2ba002557667739a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81701) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 09:06:07.337177 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:07.337838 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG keystone.notifications [None req-a1723912-3d4c-4615-9761-42a54433c78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81701) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 09:06:07.339333 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: [pid: 81701|app: 0|req: 1463/2942] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 09:06:07 2022] DELETE /identity/v3/projects/c5638b9130254e2ba002557667739a0f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 09:06:16.999839 dv-cinder-855479-1-iscsi devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 09:06:17.333877 dv-cinder-855479-1-iscsi devstack@keystone.service[81701]: DEBUG dbcounter [-] [81701] Writing DB stats keystone:SELECT=63,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}